Home  |  Index  |  Dotnet4all Snippets  |  Submit resources
About  |  Mail us  
Dotnet4all Logo

  Basic data processing with .net (Friday, September 03, 2004)




Found the following interesting discussion in the Newsgroups:

Basic data processing question
by:Anonymous

I am in the process of writing the middle tier for an application. This application will grab records, runn them through a process and save them in a table. In going through this process I'll have a staging table from where I grab the records before they are analized and saved into the history table. There is no telling how many records there will be in the staging table for processing, but potentially it could be in the thousands (or at least I would like to be prepared for that many records from a performance stand point).

My question is performance wise, do I use arrays to load all the records for processing or do I just parse through a recordset? My guess would be that arrays are much faster than recordsets because you have the database connectivity issue, but I still have the issue of loading the working array from the staging table.


 Reply:
by:William Ryan eMVP

 Danny:

Why not just use a Dataset with multiple datatables?


 Reply:
by:Anonymous

 Would that be faster than arrays? I guess I have the idea (maybe erroneous) that recordsets are more resource intensive than arrays that are already disconnected from the database.








 
Previous Posts
    - Multiuser Problem in .net
    - MD5 checksum of Visual Studio 2k5 preview
    - scrollbar.scroll event occuring twice
    - Help with Graphics primitives
    - Setting button image with vb.net
    - ByRef parameters for objects / reference types
    - Two combo boxes tied together on data set with .ne...
    - Reducing some array lines of code with .NET
    - Webbrowser Control Question
    - How to unload a COM DLL?

Archives
    - 08/01/2004 - 08/08/2004
    - 08/08/2004 - 08/15/2004
    - 08/15/2004 - 08/22/2004
    - 08/22/2004 - 08/29/2004
    - 08/29/2004 - 09/05/2004
    - 09/05/2004 - 09/12/2004
    - 09/12/2004 - 09/19/2004
    - 09/19/2004 - 09/26/2004
    - 09/26/2004 - 10/03/2004
    - 10/03/2004 - 10/10/2004
    - 01/02/2005 - 01/09/2005
    - 01/09/2005 - 01/16/2005
    - 01/30/2005 - 02/06/2005
    - 01/01/2006 - 01/08/2006


Disclaimer & Terms of Use  | DotNet4All.Com concept & © 2004 - 2007 by  Zelders²  - Holland