11/6/97


Dear List



3D reconstruction from TEM images requires high resolution digital

images. With the use of scanners with spot sizes of down to 7 microns

a single sheet of em film produces a huge image file. With the need

to collect hundreds/thousands of such images to improve

resoultion/noise in reconstructs what are peole doing to store all

these files?

The files need to be stored so that they can be retrieved sensibly so

tape archiving is not suitable.

Is the technology available and at what cost?



Looking forward to a stimulating discussion.





Chris





Chris Gilpin

Biological Sciences Electron Microscope Unit

G452 Stopford Building

Oxford Road

Manchester

M13 9PT

phone +44 161 275 5170

fax +44 161 275 5171

http://www.biomed.man.ac.uk/biology/emunit/emhome.html


You didn't mention the file size, but for large images files I have been

using a

writeable CD (CD-R). It is anyone's guess how long technology will be

around to

read the CDs, but seems the best bet at this time. DVDs are a coming

possibility for even more storage. The last blank CDs I bought were <$1.50

each. For 650 megs of storage, "that ain't bad".



Woody White, Electron Microscopist SEM/EDS/WDS



Work: Mcdermott Technology, Inc.

woody.n.white@mcdermott.com

http://www.mtiresearch.com/



Home: woody.white@worldnet.att.net

http://www.geocities.com/capecanaveral/3722




Disclamer: I am NOT a vendor, I sell nothing (except perhaps my

soul), I have done my best to come up with reasonable current market

pricing in all the following comparisons and this is a LONG email.



Yes, high resolution images (which maintain their resolution, i.e.

not subjected to 'losey-compresion') do take up alot of storage space

- as my students are constantly shocked at. Storage of these images

is problematic, and presently there is no ideal soloution, but here

are some for consideration:



Definitions: Mb= Megabit (Divide by 8 to get MB), MB = MegaByte,

GB=Gigabyte, 1000MB = 1GB (Hey some of us are really just starting

out) and $ = U.S.D.



In order to make some sense in comparison I have choosen the

simplistic view in regards to data transfer rates (i.e. the speed for

transfering data between the storage device and the computer

system/software) and simply have relied on manufacturers reported

transfer rates. Things to keep in mind with these numbers (1) you'll

never see these speeds in reality - they are all determined in ideal

situations not real world usage, but they are comparable with each

other; (2) Actual transfer rates will vary depending on the

interface used (i.e. the max. throughputs for the interfaces are

EIDE (1-10MB/sec) vs SCSI (5-10MB/sec) vs SCSI-Wide (20MB/Sec) vs

SCSI-UltraWide (40MB/Sec) vs parallel ports (<1 vs Fiber Coupling

(a.k.a. Fire Wire, 100+MB/Sec), (3) System configuration will also

effect this; i.e. what CPU, what BUS speed, how much memory (RAM)

what other components are in the system, what operating system, etc.

, (4) the biggest factor in the data transfer numbers game is

"Maximum Burst" transfer speed vs "Throughput speed". My only hope

in presenting this information is that is gives you a starting point

for comparisons.



1) Zip drives are cheap ($140 for drive) but cartridges are

expensive ($13 / 100MB - I'll use 100MB as the standard unit for

price comparison). 100MB is not very much storage capacity, and the

transfer speeds are very slow @ 1MB/Sec NOTE: unless you have min.

650MB free HD space you can NOT record an entire CD directly (On

-The-Fly) from a a zip drive, you'll have to record in multisession

mode (and lose 13MB in "overhead" for each session after the first

one, i.e. a 640MB CD-R would require 6 Sessions thus loosing 65 MB).





2) Iomega JAZ drives: $300/400 (Int/Ext) with 6.73MB/sec transfer, 1GB

cartridge@$124 [$12/100MB] (Expensive AND slow!)



3) Don't be so quick to reject tape storage. Tape storage can be

extremely cost effective in larger formats, speed can be a problem

but going back to older work-around solutions, users wishing to work

on files on Tuesday could transfer the data from tape to HD Monday

night, and then transfer back - alternately, utilizing a file server

for this task (File Server: HD's, Tape drives, CD-drives for

handleing just data storage: reading and writing only, no running of

other software) would free up workstations for computational work.

Yes, random access is limited but if you're looking at serial section

reconstruction you'll be accessing sequentially anyway. CON: You

have to a have a drive to read and write the data (unlike ubiquitous

CD-ROM readers).



Some general tech specs:



2GB drives ($600), 11MB/sec, tapes @ $10 [ $0.50/100MB]



2-4GB drives ($350-600), 29-42MB/sec, tapes @ $31-10

[$1.50-0.25/100MB] NOTE: Cheaper drives + More $ tapes



4-8GB drives ($750-1,200), 32-66MB/sec, Tapes @ $16-28 [$0.40

- 0.22/100 MB]



7-14GB drives ($700-1,600), 60-120MB/sec, tapes @ $16 [$0.22 -

0.11/100MB]



12-24GB drives ($1,000-1,300), 120-132MB/sec, tapes @ $32-42 [$0.35 -

0.13/100MB]



Drives go upto the following: 20-40GB, 32-64GB, 70-150GB, 100-200GB,

140-280GB @ $2,000-9,000.



NEW Iomega Ditto Max drives: upto 7GB* drives @ $200, upto 10GB*

drives @ $300, (*these are compressed data values, compression will

slow down transfer speeds) with transfer speeds upto 36MB/sec and

tapes running $20/3gb - $35/10GB [$0.20-$0.30/100MB].







4) CD-ROM storage: This makes alot of sense, since 99% of all

computers come with CD-ROM readers. If you (or your users) have

older CD-ROM readers, then they will need to cough up $80-150 to buy

a newer one (10x IDE drive - 16x SCSI). For comparison sake a 1x

refers to the standard speed of an Audio CD and allows for

150kilbytes of data transfered per second. Therefore a 10x CD-ROM

would allow for upto 1.5MB/second transfer. Actual transfer rates

will vary depending on the interface used (i.e. IDE vs SCSI, etc.).



CD-Recorders (CD-R's): these vary ALOT in recording speeds (1x-4x

-6x?) and prices follow ($340 - $800), plus you'll need recording

software ($50-100), and its recommended that you have a dedicated

temporary storage drive for the higher recording speeds ($180-500).

CD-R's are sensitive to recording errors, but they have become much

more routinely reliable in the last 1-2years (particularly with a

dedicated temp storage disk). CD-R's are WORM disks (Write Once

Read Many), that means if you record practice images, you can't

erase them and re-use the space. However, the recording media is

reasonably cheap @ 3.50-5.00/640MB disk [$0.54-0.78/100MB].



CD-ReWriteables (CD-RW): These are new to market as of this spring

they do allow for re-writing to the media. There are still only a

few manufactures and they record at 1-2x presently and cost ~$500.

The media is also very expensive ($25/disk) but is expected to drop

too reasonable prices by early next year. However! CD-RW's

apparently can only be read in CD-RW drives and NOT normal CD-ROM

drives. Ricoh does offer a drive which fuctions as CD-ROM, CD-R, and

CD-CW (MediaMaster ~$550).







5) DVD anyone? (and NO "DVD" is not a an anacronym, it once was but

had three different definitions so the powers that be decided to just

leave it as DVD). This ones easy: NOT READY FOR PRIME TIME YET.

Currently readers only are available, and recorders MIGHT be come

available late 1998, however the major manufactiring groups have had

a falling out again after coming up with a "standard" recording

format, and there are two incompatible (?) formats heading our way

so it might be until 1999-2000 before this becomes a

reality and affordable. However, it may offer the best solution to

todays image storage problems, in that the DVD storage capacity is

4.7GB for single sided and 7GB for double sided. But we shall see,

eh?



6) Optical Drives: Currently available optical dirves are

ReWritable (there are still some WORM drives though) fall into two

major categories: Mageneto-Optical (MO) drives and PD Drives. MO

drives come in various sizes from 128MB upto 4.6GB, I would suggest

that only drive 640MB and larger be considered. PD drives come in

640-650MB sizes, these sizes are very nice because they match the

CD-R size. Therefore you could use the MO or PD for temporary

storage and then archive to CD-R. However, once again you need to

have a drive to read these MO or PD's as well as write them. Most of

the drives will handle the next 2 or 3 sizes smaller capacity disks,

i.e. the 2.6GB MO's will read/write 1.3 & 650 disks. Prices are as

follows (Internal/External):



MO Drives:



640MB, $430/500, disks @ $30 [$4.68/100MB]



1.3GB , $1,200/1,300, disks @ $33 [$2.54/100MB]



2.6GB, $1,550/1,650, disks @ $45 [$1.73/100MB]



4.6GB, $1,450/1,550, disks @ $99 [$2.15/100MB]

[MediaStore has the Mitsubishi 4200 4.6GB on sale for $999!

4.2MB/sec transfer]



640/650 PD drives: $350/440, disk @ $34 [$5.20/100MB]



Toray has a 650 PD, 900kilobyte/sec which is also a CD-ROM reader for

$315/405.



7) Removable hard disk frames: Another alternative, one which has

been choosen by Hollywood (See Advanced Imaging October 1997, P.74)

is the usage of removable harddrives. Frames for making HD's

removable run: $20:IDE; $30:SCSI; $70:SCSI-Wide. However this does

not include the cost of the drive (obviously). Secondly, HD's are

delicate instruments and care must be taken when moving them about,

but a rack close to a user accessible computer system (say one with a

CD-Recorder?) would be a useful solution for the highest speed data

transfer. 2-6GB IDE's @ $7-5/100MB, 2-10GB SCSI @ $7-10/100MB,

2-23GB SCSI Ultra-Wides @ $7-20/100MB (On all HD's Bigger drives

have lowest costs per MB).





There are a few other, less common solutions, and each faclity will

need to develope their own prefered solution. However, I'm sure

there are a number of vendors out there who'd love to sell you a

turn-key system package for $20-40k.







Richard E. Edelmann, Ph.D.

Electron Microscopy Facility Supervisor

352 Pearson Hall

Miami University, Oxford, OH 45056

Ph: 513.529.5712 Fax: 513.529.4243

E-mail: edelmare@muohio.edu


I think you may have misquoted the above tape speeds. Based on my

experience, it is more likely that the above speeds are in MB/minute

instead of MB/second. That would place typical tape-drive speed more

in line with that of the Zip-drive. Also, most tape-drive software

accesses the tape in a sequential fashion, not randomly like the other

media. This means when you wish to relocate a particular file, it will

take a lot longer to get it from tape than from conventional media.





Jeff Ingeman Development Engineer

Department of Anatomy & Neurobiology

Department of Physiology & Biophysics

University of California - Irvine

(714) 824-7536

jingeman@uci.edu

jingeman@aol.com

jingeman@yahoo.com


I don't get why users would have to buy a 10x IDE or 16x SCSI drive. Can't

the CD's be written in a standard format that can be read at any speed?? I

am about to buy a CD writer and apparently have missed something here.

TIA, Tom



Thomas E. Phillips, Ph.D.

Associate Professor of Biological Sciences

Director, Molecular Cytology Core Facility

3 Tucker Hall

University of Missouri

Columbia, MO 65211

(573)-882-4712 (voice)

(573)-882-0123 (fax)

tphillips@biosci.mbp.missouri.edu


I think Richard was saying that it may be worth the $100 or so necessary to

upgrade the older 1X to 4X units to the faster speeds. I worked with a 1X

for a few years. It was better than nothing, but it was slow!



Now a question for Richard. Do the tape drives really achieve 20 MB/sec or

did you mean 20 MB/min? Our Ditto 2GB is on a flopy port and is doing well

if it does 10 MB/min.

----------------------------------------------------

Warren E. Straszheim

23 Town Engineering

Iowa State University

Ames IA, 50011

Phone: 515-294-8187 FAX: 515-294-8216



E-Mail: wesaia@iastate.edu (or: wes@ameslab.gov)

http://www.marl.iastate.edu/marl/ (re: SEM)

http://www.public.iastate.edu/~iprt_info/cfce/ (re: coal)


It is my experience that CDs written with our HP 4020 drive cannot be read

on 1X CD readers. I have even encountered some 2X drives that don't like

the written discs. (Discs are written at 1x speed.) We have 2 writers and

the same holds true for CDs written by either drive. Never had a problem

with a 4X or higher reader.



Bob Holthausen

Pall Corporation

Port Washington, NY

Bob_Holthausen@Pall.com


Hi everybody

Here is my (short)experience on CDR.

I have a Sony CDR 928 on IDE Bus ( all my system is IDE not SCSI)and the

first pb I encounter is that my old Windows95 version never never recognize

this CDR. So I installed an OSR2 version on a new disk and all was OK.

The software is easy CD pro from adaptec (upgraded for IDE). First writing

(600Mo) no problem but impossible to read the datas on my 1 years old CD

8x. I check on many other even on a very old 2x Mitsumi and all was OK.

So I change for a 24x Pionneer (the CDs were from Sony).

All that takes at least one week late at night!

My conclusions are the following:

Writting speed doesn't affect reading, it's just a safety, the slower the

safest.

Never use Multisession, the price of CDs is now as low as 2$ and doesn't

justify that.

I use different manufacturer for CDs (SONY TRAXDATA...) without PB.

You can never be sure that your work can be read on all CD for example

I've made an Audio which is readable by all CD except on a JVC CD!

I enclose a part of my Easy CD pro user's manual that prove that

manufacturers know the problem.

I have no interrest in any of the above company (just problem with some!)

and this is my personnal opinion.

If more information needed pls Email me.



FROM EASY CD PRO VERSION 2.0 ADAPTEC USER'S GUIDE



Problems Reading Recordable CDs

If you have successfully written a CD but have problems reading it,

there are a number of possible reasons :

* If the CD can be read on the CD recorder but not on a standard CD-ROM

drive, check in Disc Info and Tools to make sure that the session

containing the data you just wrote is closed. CD-ROM drives cannot read

data from a session which is not closed.

• If your CD is ejected, or you receive an error message, or you have

random problems accessing files from the CD, the problem may be that your

CD-ROM drive is not well calibrated to read recordable CDs.



a If you recorded the CD using the DOS filenames option in the File Names

tab, but there are nonetheless difficulties in reading back the CD on DOS

or Windows OR 3.1 system, it may be that you have an older version of

MSCDEX (before version 2.23) on your system.



Problems Reading Multisession CDs

If you can see only data recorded in the first session on the CD but not in

subsequent sessions, it may be that

• You recorded the CD in CD-ROM (Mode 1) format, while your multisession

CD-ROM drive only recognizes CD-ROM XA (Mode 2) multisession CDs.



or,

• Your CD-ROM drive does not support muti session at all.



If you can see only data recorded in the last session, you may have

forgotten to link your new data with data previously recorded on the CD.

Make sure to select a track in the Load Contents tab before recording.



CD-ROM Drive Incompatibility with Recordable CDs

Sometimes, it appears that you wrote a CD without trouble and can read it

on your CD recorder ; however, when you put it in a standard CD-ROM drive,

the CD is ejected, or you get error messages such as no CD-ROM or not ready

reading, or you have random problems accessing some files or directories.

You may find that the problems vanish completely when reading the CD on a

different CD-ROM drive.

This maybe due to compatibility problems with some CD-ROM drives,

especially older ones, and recordable CDs. Some CD-ROM drives' lasers are

not calibrated to read recordable CDs, whose surface is different from that

of factory-pressed CDs. If your CD-ROM drive reads mass-produced (silver)

CDs but not recordable CDs, check with the CD-ROM drive manufacture to

determine whether this is the problem. In some cases , an upgrade is

available which will solve the problem.

The combination of CD brand and CD recorder can make a difference. Use CD

media recommended by your CD recorder manufacturer.



==========================================================

Jacky Larnould

mailto:larnould@worlnet.fr

voice:33 (0)4 67 72 28 26

fax :33 (0)4 67 79 54 90


I have several thousand confocal images (TIFF single files, 8bit

grey, 24 bit RGB, z-series etc.) and I was wondering whether

there is

some relatively cheap software/shareware around that I could use

to

catalogue the images. I want to be able to save some information

with

the images and thumnail sketches would be useful.



Alternatively, if someone knows how I can use Microsoft Access as

an

image database without having to embed the full resolution

picture in

each record I would be grateful.



Any ideas? contact Mark Auty

Mark Auty

DPC Moorepark

Fermoy

Co. Cork

Ireland

I use Thumbs Plus (approx. $60 US if I remember correctly)

Cerious Software, Inc.

1515 Mockingbird Lande

Suite 209

Charlotte, NC 28209

http://www.cerious.com



I have no financial interest in this company other than doing my part as

a very satisfied customer.

Crossman, Harold

crossman@OSI.SYLVANIA.com


Thumbs plus by Cerius Software works very well for us as an image filing

tool. It provides a thumbnail of all images in a directory.

Jay Jerome

jjerome@bgsm.edu


Mark,



Company Cerious Software Inc. http://cerious.catalogue.com/index.html

has a great software ThumbPlus 3.0 for 60 US$.



Henrik Kaker

SEM-EDS Laboratory

Metal Ravne d.o.o.

Slovenia


ThumbsPlus is very good. I've used a single site license. In my new

position, I've just gotten 5 concurrent site licenses for myself and my

team. I don't know how good their Mac version is. I believe that it is

still in beta testing. It is shareware and Cerious software has a website

where you can download the shareware version. Once you are registered,

there are some things that are available, but the unregistered version is

very good. I tried it out that way after it was suggested previously on the

Microscopy Listserver.



-Scott Walck


Mark,

I've been using a product called imageAXS CE v3.0. This is a free version of

a slightly more flexible commercial program. It automatically finds image

files and creates a MS Access database which you can edit and use for

searching and indexing images. the url is:



http://www.dascorp.com



Hope this helps glenn







Glenn Poirier Tel (514) 398 -6774

Electron Microprobe Laboratory Fax (514) 398 4680

Earth and Planetary Sciences glennp@stoner.eps.mcgill.ca

McGill University

http://castaing.eps.mcgill.ca

3450 University St.

Montreal, Qc H3A 2A7


Check out PAX-it, an excellent image capture, archiving and databasing

system. It has pretty powerful report generation software which allows you

to effectively replace traditioinal film in the photo documentation

process. Going digital seems to pay for itself quickly. The other good

thing is that it has network software, so you can access the database of

images from your desktop PC's.



They are at www.mis-hq.com.

Seth J. Grotelueschen

sethg@CompuServe.COM


[Return to Tips & Tricks Menu]