Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Challenges implementing BULK INSERT? #365

Open
JockLawrie opened this issue Apr 20, 2023 · 0 comments
Open

Challenges implementing BULK INSERT? #365

JockLawrie opened this issue Apr 20, 2023 · 0 comments

Comments

@JockLawrie
Copy link

Hi there,

I have a large table (~300GB) that is constructed as multiple tables that each contain a subset of the rows.
Each of these tables is written to disk, occupying around 1GB as CSV data. This happens using Julia.
This data must ultimately exist as a single table in a SQL Server database.
I can code a function to BULK INSERT each file to the database.
Would such a function be a suitable addition to this package?
Are you aware of any pitfalls/obstacles to this approach?
Is there a better way?

Cheers,
Jock

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant