Writing a binary fikle using C#

Question

I'm writing a binary file using C#.

My algorithm, etc are all correct and I have validated using witing of small binary files (when I say amall, I mean of sized 200 to 300 MB)

but when my files size becomes as larghe as 2GB (I want to write a file of size 6GB), the process goes on endlessly.

Any clues, what might be happening?

Thanks a lot.

Tapan Patel · Answer

It would be good if you can share a little bit of code to understand the problem.

Tapan Patel · Answer

As you are using byte array just make sure that byte array is not filling your RAM entirely (observe Task Manager or Diagnostics while running the application). So at the end of each iteration byte array should be having kind of new reference. Second question is you are writing the binary file to disk or some place on network look for the size of the disk where you are writing (as you mentioned nothing gets written after certain file size). Also try to wrap your code in Try/Catch/Finally block so that you would know if there is any exception. As I have no code to look at these are all assumptions.

Tapan Patel · Answer

okay. two things to check then. 1. Are you flushing the data (or array) once your one cycle of writing file is complete? 2. As you are writing file to disk/SAN how about disk size (it sounds crazy but don't want to miss a chance).

Tapan Patel · Answer

okay this is what I have found till now. As you are writing a binary file you must be using the byte array to write that data and I believe you are trying to write a file together I mean in one shot. Here is the problem. As it is an array which takes Integer as an index that index limit depends on the processor you are working with. And that is an answer to your first question that what should be the maximum size of that file. So I would suggest to write the file in chunks instead of all in one attempt. It should work for you.

Tapan Patel · Answer

How about RAM size?

Sahil Dev · Answer

Sorry Tapan I don't follow this As you are using byte array just make sure that byte array is not filling your RAM entirely (observe Task Manager or Diagnostics while running the application). So at the end of each iteration byte array should be having kind of new reference. I have 700 gb disk space free

Sahil Dev · Answer

Hi Tapan 1) I'm not flushing. How to do that? 2) Sorry I do not follow your second questuiion

Sahil Dev · Answer

Hi Tapan No I'm not writing in one shot. I write it inin chunks. Writing in chunks works until the file size is 2096128 KB but beyond that nothing gets written in the binary file.

Sahil Dev · Answer

I shall be really grateful if helped.

Sahil Dev · Answer

Can anyone please adevise?

Sahil Dev · Answer

I don't think it will help..but will surely do. One question: 1)Is there a maximum limit on the binary file size that could be written? 2)Because I have always found problems based on machine configuration when my binary file size exceeds 2.5 GB