XML DB file into RDB

Question

Hello...

I'm now participant in c # corner, i have been read articles over here many times ago.
I decide to share you the problem i have in dealing with XML database file !!!

><"!
the idea is as follow:
i have a huge xml file, about 641 MB !!!
and i need to extract the information into RDBMS !!
the file contains information of

BOOKS

ARTICLES

CONFERENCES

JOURNALS
.. etc

until now, we found a way to categorise the infromation!!
But how can we read the file and store it as RDB, MYSQL server ???

thank you.

Sam Hobbs · Answer

You can use either XmlSerializer or XmlReader. If you need all the data in memory to be processed in memory then use XmlSerializer. If you need to just read the XML file and write it out as it is read without having to access other parts of the data that is in very different locations then use XmlReader. The choice might not be very obvious but I don't know the details of the data. You might be able to use the output database to refer to as you build the outpur; for example if you have a table of subjects and a table of authors and a table of publishers then you can build those tables first and then use the database to insert publications and use the existing tables to relate the subjects authors and publishers to the publications. There are probably utilities you can use without writing any code. You could process the data into a database and then process it more as needed.

Amal · Answer

Sam thank you your post and the links help me alot. the problem is solved now! and a new matter comes up !! >> i have a DB contains many filds one of those is a link to a webpage that contain an abstract of a book !! i need to read this abstract only out of the whole web site and save it to the DB ... i have some ideas in my mind !! but get confused how to start !!

Amal · Answer

thanks alot. i will check them. =)

Sam Hobbs · Answer

Have you read DBLP — Some Lessons Learned ? It looks very relevant. Also see: Examples of Bulk Importing and Exporting XML Documents Validation Using a DTD with XmlReader

Amal · Answer

i take a copy from a friend she already have the same copy !! even the file is in my pc im not open it from the web page itself PC get stuck > i study the xml file at least the main parts i got ACM CD that help me too. but still with some error while reading and storing in SQL server 2005 DB !! then serach for specific infromation >

Sam Hobbs · Answer

Have you downloaded the file? I download it using BitComet .

Amal · Answer

OOps .. i forget to tell that all PCs i tried get stuck when trying to upload the xml file !! >>>really huge!! yeah there is a DTD file i just put it in the same dorectory where i store and read the xml file ><

Sam Hobbs · Answer

Yes that is a huge file and I made the mistake of trying to look at it. I was writing a reply to you but lost it becasue my system got hung up loading the XML. I see a DTD for the XML file. Are you using the DTD?

Amal · Answer

we use the located dblp xml file to build a web based agent http://dblp.uni-trier.de/xml/ dblp.xml 658M the structure it self is not stable !!! we faced a problem in reading it but almost solved !! so the work until now is : 1- creat DB tables in SQL 2005 server (DONE) 2- read data from XML file ( almost done ) >> we knew how to read but still some problem in ordering the data !! some errors came up !! and some data didnt appear > 3- Access DB using ASP.net (almost done) >> we knew the idea and how to do it .. but still didnt try it unless we complete the issue of the XML file what utilize may i use??