Binary file through C#

Question

I amn writing a binary file.

My problem is in my machine after I write the file to 2GB the writing of the file gets stuck and nothing gets written. The input output operation stops.

I don't have a RAM problem or a disc space problem. My RAM is 48 GB and have sevral GB disc space free.

I really need to sort this. Can anyone please help why this occurs?

Ali Haider · Answer

C# program that uses BinaryWriter using System.IO; class Program { static void Main() { W(); } static void W() { // Create 12 integers. int[] a = new int[] { 1 4 6 7 11 55 777 23 266 44 82 93 }; // Use using statement and File.Open. using (BinaryWriter b = new BinaryWriter( File.Open(file.bin FileMode.Create))) { // Use foreach and write all 12 integers. foreach (int i in a) { b.Write(i); } } } }

Tapan Patel · Answer

if .NET 4.5 is the issue then you would get something as an exception. Also there is no TRY/CATCH block in your code. try adding some  then only you will get an exception. Did you find anything in Event Viewer?

Tapan Patel · Answer

Having RAM of 48 GB doesn't mean processor is able to use them all. It really depends on the operating system (32 bit or 64 bit). Like I said in the previous thread you opened provide some code to understand the issue.

Ramesh Palaniappan · Answer

C# program that uses BinaryWriter using System.IO; class Program { static void Main() { W(); } static void W() { // Create 12 integers. int[] a = new int[] { 1 4 6 7 11 55 777 23 266 44 82 93 }; // Use using statement and File.Open. using (BinaryWriter b = new BinaryWriter( File.Open(file.bin FileMode.Create))) { // Use foreach and write all 12 integers. foreach (int i in a) { b.Write(i); } } } }

Sahil Dev · Answer

How/where did you get the eventviewer screenshot from?

Tapan Patel · Answer

Insert try catch block where you start writing bytes to file or while creating new line to file. this .FileRep.WriteNBytes(nbytes);

Tapan Patel · Answer

I would still suggest to add Try Catch first in your code and see where it fails. It is utility by windows where all events happening in current machine gets recorded. Take a look at below screenshot. Look for something that has Error level immediately after you try running the program. (Be patient while it loads as there would be thousands of events data to be loaded)..

Sahil Dev · Answer

Hi Tapan Can you advise where to put the try catch block? Also about the event viewer?

Sahil Dev · Answer

Thanks sorry I did not get about the event viewer? Where to look for that?

Sahil Dev · Answer

No exception. IT just stops to work (that is nothing gets written into the file)after generating file size of 1.5GB On another machine it stopsafter generating file size of 2GB

Tapan Patel · Answer

Your code looks okay but is it throwing any exception? Try debugging the code (with setting as Break on All Exceptions) and see if it hits any exception). At the same time go through event viewer if OS is throwing any error which is not captured in CLR.

Sahil Dev · Answer

MAnas/Tapan Tapan: I posted my code as you advised MAnas: I replied to your questions regarding the links. Tapan/MAnas: Do you think NOT having .NET 4.5 is the reason for the problem?

Sahil Dev · Answer

//HereIbeginwriting writer.WriteFEM(meshedResultsPath.Combine(OuputsPath WithPlasticStrains.fem )); public void WriteFEM(ITemporalMeshedResultsresultsstringfilename) { this .filename=filename; this .FileRep= new BinaryItemFileWriter(filename); this .Write(results); } private void Write(ITemporalMeshedResultsresults) { this .FileRep.Close(); if (File.Exists( this .filename)) { File.Delete( this .filename); } this .FileRep.Open(); //nontimebasedresults: if (ItemsToWrite.Contains(ItemKeywords.NodalCoordinates)) { this .WriteNodalCoordinates(results.Mesh.Nodes); } if (ItemsToWrite.Contains(ItemKeywords.NodeLabels)) { this .WriteNodeLabels(results.Mesh.Nodes); } if (ItemsToWrite.Contains(ItemKeywords.Topology)) { this .WriteTopology(results.Mesh); } if (ItemsToWrite.Contains(ItemKeywords.ElementData)) { this .WriteElementData(results.Mesh.Elements); } int []navstrs= this .WriteOutputLocationRelatedItems(results.Mesh.Elementsresults.Meshrefiavstrs); int []iavstrsArray=iavstrs.ToArray(); //timebasedresults foreach(vartimePointinresults.TimePointManager.TimePoints) { int ramp; int step=1; if (timePoint.SubSteps.Count>=2) { ramp=timePoint.SubSteps[0]; step=timePoint.SubSteps[1]; } else if (timePoint.SubSteps.Count==1) { ramp=timePoint.SubSteps[0]; } else { ramp=timePoint.TP; } if (ItemsToWrite.Contains(ItemKeywords.CaseData)) { if (timePoint.SubSteps.Count>=2) { this .WriteCaseData(timePoint.Time0.0rampstep0); } private void WriteNodalCoordinates(INode[]nodes) { ItemRecorditem= new ItemRecord(); item.SetName(EnumMethods.GetStringValue(ItemKeywords.NodalCoordinates)); item.It=2; int nn=nodes.Length; //item.N1=coords.Length/3;//cols //item.N2=3;//rows double []coords= new double [nn*3]; for ( int i=0;i { coords[i*3]=nodes[i].Coordinates.X; coords[i*3+1]=nodes[i].Coordinates.Y; coords[i*3+2]=nodes[i].Coordinates.Z; } item.N1=3; //cols item.N2=nn; //rows item.N3=0; item.DData=coords; this .WriteHeader(item); this .WriteItem(item); } public void WriteItem(ItemRecorditem) { RR.Utility.Logger.InternalLogger.WriteLine( WritingSC03item +item.Name); //fs.Seek(item.OffsetSeekOrigin.Begin); int length=Math.Max(item.N11)*Math.Max(item.N21)*Math.Max(item.N31); int req_cols=Math.Max(item.N11); int req_rows=Math.Max(item.N21); int nbytes=GetNBytesForItemData(item); this .FileRep.WriteNBytes(nbytes); if (item.IsGraphicalItem()) { this .WriteGraphicalItem(item); } else if (item.It==1) { for ( int i=0;i { this .FileRep.WriteInt(ItemWriter.FormatI13item.IData[i]); //determinewhethertowritenewline. if ((i+1)%req_cols==0&&! this .FileRep.IsWrapped) { //ifwearenotthelastentry if (i+1!=item.IData.Length) this .FileRep.WriteNewLine(); } } } else if (item.It==4) { for ( int i=0;i { this .FileRep.WriteFloat(ItemWriter.FormatD17_9item.FData[i]); if ((i+1)%req_cols==0&&! this .FileRep.IsWrapped) { if (i+1!=item.FData.Length) this .FileRep.WriteNewLine(); } } } else if (item.It==2) { for ( int i=0;i { this .FileRep.WriteDouble(ItemWriter.FormatD25_17item.DData[i]); if ((i+1)%req_cols==0&&! this .FileRep.IsWrapped) { if (i+1!=item.DData.Length) this .FileRep.WriteNewLine(); } } } else if (item.It==5) { float []FData= this .EncodeRLE(item); for ( int i=0;i { this .FileRep.WriteFloat(ItemWriter.FormatD17_9FData[i]); if ((i+1)%req_cols==0&&! this .FileRep.IsWrapped) { if (i+1!=FData.Length) this .FileRep.WriteNewLine(); } } } this .FileRep.WriteNBytes(nbytes); this .FileRep.WriteNewLine();

Sahil Dev · Answer

Operating system is 64 bit. I'll paste some code.

Sahil Dev · Answer

Thanks. Regarding the first link: https://bhrnjica.net/2012/07/22/with-net-4-5-10-years-memory-limit-of-2-gb-is-over/ My .NET version is 4.0.30319 NOT 4.5 Does thatmean I cannot write binary file sizes greater than 2GB? Please note that I'm not writing in a single go. I'm writing in several chunks of 400 to600 MB each. Regarding your second link; http://stackoverflow.com/questions/5654298/filestream-read-write-methods-limitation It only suggests not to write in single go but write in chunks which I am already doing? IS the problem related to the .NET version?

Manas Mohapatra · Answer

Below links may help you: https://bhrnjica.net/2012/07/22/with-net-4-5-10-years-memory-limit-of-2-gb-is-over/ http://stackoverflow.com/questions/5654298/filestream-read-write-methods-limitation

Sahil Dev · Answer

I can read file as large as 8GB. My problem is writing of the file. When the written size becomes 2GB the input output stops. The physical emmory consumed is 32% until such time

Manas Mohapatra · Answer

Follow below link that may help you: https://social.msdn.microsoft.com/Forums/vstudio/en-US/4e200751-bd99-4ecc-a692-13043bee7d42/how-to-readwrite-files-2gb-?forum=netfxbcl

Sahil Dev · Answer

It is working perfectly upto even 1.9 GB. The problem starts when the file size reached a certain limit (exact). Why wouldthe memory problem arise?

Manas Mohapatra · Answer

For cross write data less than 2 GB and see whether it working properly. If it works then it is memory problem. Secondly share the code how you are writing data to file.

Sahil Dev · Answer

Can someone please help as I have really been struggling with this and its been very long