Continue to Site

Welcome to EDAboard.com

Welcome to our site! EDAboard.com is an international Electronics Discussion Forum focused on EDA software, circuits, schematics, books, theory, papers, asic, pld, 8051, DSP, Network, RF, Analog Design, PCB, Service Manuals... and a whole lot more! To participate you need to register. Registration is free. Click here to register now.

Network based data capture and storage application

Status
Not open for further replies.

premod_dm

Newbie level 4
Joined
Nov 9, 2006
Messages
5
Helped
0
Reputation
0
Reaction score
0
Trophy points
1,281
Location
Kochi
Activity points
1,313
We are starting an application on a standard Linux distribution (like Fedora Core 5) running on a PC or a Single board computer that involves transferring of data over Ethernet at millisecond intervals and storing this on some media like HDD, Flash drive.

What all aspects should be consider? How to check if the Linux stack can handle packets at that rate? Also how can we write data at high speeds (15-20 MB/s) to HDD?

Any one having experience in related areas, pl. help.
 

To start, you need a capacity planning to know the "weight" of the that you think to write. What do you want to capture? Entire packet? Only header's?

Surely, flash drive is the whorse choice.
You need a large storage device, such a NAS/SAN, with a high speed access (e.g. FB channel with FB disk); after this, to capture and write the data, my suggestion is to balance the work on more process: for example you can start one process for each layer 3 protocol to write (in real time) data separately; after this, start one daemon to process each writted file, . Don't use a application queue to store packet in memory; if you don't know the volume of the data, you could lose the controll of the application. My suggestion is to planning more space then needed on storage, to have a kind of "lung" to write and to read data in separately time.
 

Status
Not open for further replies.

Similar threads

Part and Inventory Search

Welcome to EDABoard.com

Sponsor

Back
Top