 |
Mapped pictures: image annotation |
|
Diagramatic pictures allow more focused, tighter commentary on pictures, compared to text or captions outside the picture frame. I've long been concerned at how the format of this board seems to enforce a separation of text and image. I'll be trying out more mapped pictures here and would appreciate good examples of mapped pictures (for thinking about the issue in Beautiful Evidence).
Instead of a mapped picture with direct labels, here's an impediment visual-verbal encoding:
A' = Anna Z = Zerlina
A'' = Alex A''' = Abby
-- Edward Tufte
|
|
Response to Mapped Pictures
I have seen many poor attempts of this concept: they
usually involve bold black text in tiny white boxes
and lots of arrows.
One of the best examples that I can recall is in the
first few mintues of the movie Fight Club when the
main character realises that all his belongings
are from IKEA
What I would really like to see is a photo that would
only show information when viewed from a certain angle;
a bit like the little toys we used to find in Cracker Jack
boxes.
-- Tchad (email)
|
|
Response to Mapped Pictures
Here's a couple of diagrams from the pre- and nearly pre-photographic era. Both are from a nifty book, "You Are Here — Personal Geographies and Other Maps of the Imagination," by Katherine Harmon, published this year by Princeton University; perhaps you've seen it. It's a presentation of "personal maps" and has mostly map-like images of personal histories, literary places, artworks in a cartographic manner and such. But one section contains a number of very fine images of the human body in one form or another, from sources a little more off the beaten track: phrenology charts, Asian medical manuals, acupuncture diagrams, a variety of contemporary art. I'm not sure if these two qualify as mapped pictures but thought they might be of interest.
Kunisada Utagawa, Rules of a Dietary Life, ca. 1850
... "It shows the functions of the respective internal organs and instructs the reader about proper nutrition."
Sangye Gyamtso, Interconnecting Blood Vessels: Anterior View (detail), ca. 1680s
... "The chart depicts three or four major "channels" of Tibetan Buddhist medicine, with information on which blood vessels are acceptable for bloodletting."
-- Steve Sprague (email)
|
|
Response to Mapped Pictures
Not to the topic--I can't but wonder if Alex on the photo above, and Philip Greenspun's Alex (http://philip.greenspun.com/) are same breed, same name by coincident or not?
-- Priit Parmakson (email)
|
|
Response to Mapped Pictures
Yes, that's The Alex. Indeed the picture was taken by Philip. It says so in the Spring Arcs thread.
-- Edward Tufte
|
|
Response to Mapped Pictures
The idea of mapped pictures is presented in this opening of a chapter in Beautiful Evidence.
-- Edward Tufte
|
|
Response to Mapped Pictures
Ah insight! So those pictures appearing in various sign language dictionaries to teach me the language are "mapped". I don't know if the ASL/English Dictionary edited by William Stokoe used mapped pictures but certainly the Dictionary of British Sign Language/English has them --- indeed I look at them regularly so they are the ones I know best. Almost every dictionary/gloss-list of signs published here in the UK since 1992, when the BSL/English dictionary was published, uses mapped pictures in a similar style to those featured in the Scientific American article of the Nicaraguan children, which Jeff Berg mentioned. The direction (sometimes width) of the arrows encodes semantic information that is otherwise difficult to describe.
-- Trevor Jenkins (email)
|
|
Response to Mapped Pictures
The sciences, and anatomy in particular, do seem to lead the way when it comes to this sort of picture mapping. I can remember marveling at those transparent overlays that were mentioned earlier, in the Encyclopedia Britannica when I was a boy. Take Henry Gray's "Anatomy of the Human Body" as another case in point.
Notice the different typefaces and colors used to distinguish between various tissues, such as muscle and bone (although they do not seem to be completely consistent in this example), and the hyphenation of the digastricus as it passes beneath the stylo-hyoideus. Note also the inconsistent type orientation, how some of the vertical muscles are labeled with the text running up-to-down, while others run down-to-up.
I assume that the drawings in the early editions of the book were quite a bit larger than the one shown here. The illustrations in my commercial paperback edition from the 1970s are a little bit bigger, but not much, and the type in the diagrams is still fairly difficult to read. (Indeed, some of the diagrams are much more detailed than the one shown here and are nearly illegible at their currently published size.)
One wonders if these particular labeling techniques weren't in part a deliberate means to promote more careful study of the very rich illustrations in Dr. Gray's book. After all, the medical student is presumed to have seen all of these structures in the flesh (so to speak), and can study their names more clearly in the text. The object of the diagram is to associate the names of the body parts with the actual elements the students have already seen during a dissection.
Many of the other diagrams in the book use callouts with thin, arrowless lines pointing to the subject of the label. Still others use a combination of callouts and subject labels directly on the structures. In fact, it's interesting to think about why Gray chooses to use callouts instead of direct labeling in various situations. Sometimes it is simply a matter of available space, caused by the need to specify a long name for a small body part. In other cases, the use of callouts seems also to be related to the overall shape of the subject he is diagramming. Cranial diagrams, for example, seem to use direct labeling more often, and avoid callouts except for structures near the outer edges of the picture. A diagram of an arm or leg, by contrast, might use callouts exclusively. Gray seems to try to avoid callouts with long lines wherever possible, which would obviously be more difficult to parse.
This book has fascinated me for years. I'm glad for this discussion that has urged me to pull it out and pore through it again. Sometimes, you have to be reminded that there is as much detail looking inward as there is looking outward.
-- Craig Zacker (email)
|
|
Response to Mapped Pictures
What a thoughtful contribution, an interesting example right on point from Kindly Contributor Craig Zacker. Let us all now locate our sterno-cleido-mastoideus.
-- Edward Tufte
|
|
Response to Mapped Pictures
A hidden gem in Craig Zacker's post is the source of the picture: bartleby.com. With its host of free, classic references and a reading list to aspire to, this site alone motivated me to learn how to set bookmarks in my browser and make hyperlinks in documents.
-- Niels Olson (email)
|
|
Response to Mapped Pictures
Netter's image that compares to Gray's above.
Netter's callout style contrasts well with Gray's cartographic style, regretably, Icon Learning doesn't include identification in their online samples. To see the callouts, find plate 23 in Netter's Atlas of Human Anatomy, third edition.
It is worth noting that Gray names 28 structures, while, by using callouts, Netter can name 38. Netter's decompressed style also minimizes the need for line-breaking hyphens (Sterno-cleidomastoideus). Gray's cartographic style may be a nice bit of visual confection, but Netter ties more information to his image (if only I could find the image with callouts out on the web!).
-- Niels Olson (email)
|
|
Response to Mapped Pictures
Gray's drawings exaggerate the figure-ground contrast, the thick black lines on the lighter ground. Color is an after-thought. Netter's drawings avoid the black stripes, resulting in a more subtle, 3-dimensional effect, closer to reality.
-- Edward Tufte
|
|
Response to Mapped Pictures
At what point does a "mapped picture" simply become a "map"? Aerial photography, arguably consisting of images/pictures, is commonly ovarlayed with annotations and then used as basemapping in land use planning and natural resource management (as well as obvious military applications and other fields). Not knowing if it is an accepted term or not, I refer to these as "photomaps". Some examples include NRCS county soil survey mapping showing various soil series designations: http://lter.kbs.msu.edu/GIS/Images/KS12M.JPEG and FEMA floodzone/flood insurance rate maps showing estimated flood risk areas: http://www.fema.gov/fhm/ft_ex2.shtm For a recent open space exhibit, we displayed maps and photomaps of identical areas, at the same scale, side-by-side. The public seemed to extract information from both, in a parallel yet combined form, as both versions have strengths and weaknesses.
-- Mark Kasinskas (email)
|
|
Response to Mapped Pictures
Some additional Brodel images.
These are available at the National Library of Medicine's profile of
Florence R. Sabin, but aren't laid out together there. The style is very similar to Wolf-Heidiger's. Interestingly, Powell's was selling Kelly and Brodel's two volume Gynecology and Abdominal Surgery for $45, while another seller on Amazon was selling it for $270. I bought the copy from Powell's; I hope it's still readable.
Between Google and the continued exponential growth of on-line content, it is becoming remarkable easy to add information (and hopefully content) to these threads. I wonder if initiatives like The Digital Information Infrastructure and Preservation Program will help further the trend or if more content will be put behind firewalls, only accessible to intranet computers and subscribers.
-- Niels Olson (email)
|
|
Response to Mapped Pictures
I should mention that the department of Art as Applied to Medicine at John's Hopkins University has an large trove
(probably most of the finished work of his long career)
of original Brödel pen and ink and carbon dust illustrations in their archives.
Unfortunately, they are not usually on public display. But, for the students and faculty of
the program he founded at JHU, they provide extraordinary inspiration.
Nick Woolridge
-- Nick Woolridge (email)
|
|
Response to Mapped Pictures
Tufte's text asks: "Should not every explanatory image of DNA - from
journalism to science - show the molecule with a scale of measurement?"
I think not. Not every image, and particularly not every scientific image.
As discussed in other threads here, biochemical diagrams often are used summarize
information about diverse genetic and chemical interactions. Single diagrams often
incorporate graphical representations of objects ranging from a dozen base pairs (a
footprint that can be recognized by a transcription-regulating protein) to cells (>10^3
larger), tissues (another 10^3-10^7), or even organs. In such diagrams, which are
extremely common, scale is not the point - informational or chemical topology is.
In a diagram of the topology of a computer network that incorporates both local and
large-area information, scale bars showing the diameters of Cat5 or T1 cables would
be chartjunk, and nothing more. The same is true in many diagrams that include pictures
of DNA.
Moreover, for biologists who focus on molecular structure, a detailed scale drawing
that includes a DNA helix (2 nm diameter, 10 base pairs per turn, 3.4 nm per 10 base
pars), or an alpha-carbon backbone in a protein (0.5 nm backbone diameter, ~3.5 amino
acid residues per turn, spaced about 0.15 nm apart), those elements provide implicit
scale bars. These are scale indicators as recognizable to a molecular biologist or
biochemist as a person standing next to Tufte's Spring Arcs sculpture would be to most
people. It is for this reason that one rarely sees scale bars in specialist papers about
protein and DNA structure.
Certainly, scale bars should be present much more often in diagrams of DNA
and other macromolecules. But scale bars are certainly not desirable in every
illustration of this kind.
-- Alex Merz (email)
|
|
Response to Mapped Pictures
Watson and Crick's 1953 proposal in Nature for the structure of DNA included a graphic but didn't include a scale bar, although scale could be interpreted from data in the article. 
As a student taking Biochemistry right now I concur with Prof. Merz's opinion. In addition, I would add that scale bars are of minimal utility when trying to figure out mechanisms (is this carboxyl oxygen close enough to that amine to abstract a hydrogen? Can a hyrdrogen bond form there?) when compared to the 3-d ruler functions in the visualization programs. Like engineering and architecture visualizations, visualization of macromolecules is generally done with specialized software. PyMol and RasMol are examples. If they're known, the coordinates of each atom in a biomolecule in a particular conformation are available from various sources like the Protein Data Bank, which are constantly growing and provide the raw data for the visualation programs. The image below is from A. Geva, et al's report in this week's New England Journal of Medicine on a novel hemoglobin mutant, hemoglobin Jamaica Plain. The red lines represent 3-d ruler measurements, the lengths of which are reported in another frame of the visualization program this image was taken from. In this case the authors merely used the lines to indicate steric interactions created when the bulky amino acid phenylalanine is coded for where a smaller leucine should be. One (small) reason for these authors to not provide a scale bar would be that, as they state in the article, the mutant's structure has not yet been determined by x-ray crystallography (the same technique Rosalind Franklin used in her study of DNA), they just took the next closest structure, sickle cell hemoglobin, and stuck a phenylalanine in where a leucine should be.
The helices named and illustrated above are examples of the alpha helices that Prof. Merz describes.
Microscopy and images of planetary surfaces are mainly flat, so scale bars are appropriate. In molecular modeling, a scale bar may in fact be misleading because the models generally accomodate neither small changes in bond length and orientation that are inherent in macromolecules, nor significant perspective challenges posed in imaging macromolecules.
To the original question: in Geva's image, there's a trade off between abbreviation and putting the label close to the object. Compared to "F68", writing out "The 68th amino acid in the peptide sequence, a phenyalanine" would be more democratic, but would also require leader lines.
-- Niels Olson (email)
|
|
Protein Anatomy
One other addition to Niels's post: "ribbon" diagrams protein structure, as shown in the
picture attached to Niels's post above, use idealized shapes to depict the path of the
polypeptide backbone through space: helical coils or even simple cylinders for alpha
helices, arrows for the strands that make up beta sheets. The peptide backbone itself
follows a more angular, zigzag path (see here for an example from the original Pauling/Corey paper;
see here
and here
for other examples). These idealized representations, pioneered by Jane Richardson at Duke University, are now the
standard method for depicting the global 3-D fold of a polypeptide. They are sometimes
called Richardson diagrams.
In fact, the three-dimensional structures of macromolecules are sufficiently complex
that
their representation has posed problems for structural biologists that are in many ways
comparable to those confronted by classical anatomists. Such models, of course, usually
peel away the molecule's partially-ordered hydration shell and VanDerWaals "surface" to
reveal the underlying bonding topology and fold, just as anatomists leave out or peel away
skin, muscle, and connective tissue to show us the skeletal structure. It is no accident that
we refer to a protein's "backbone" conformation.
This reminds me of an additional inaccuracy: macromoecules are not, in nature,
alone. They are in a dense sea of other macromolecules, membranes, and solutes. Often
they are assembled in solid-state machines. Most often, we have little idea of what these
larger machines look like. This density is rarely illustrated, both to reduce visual clutter,
and because depicting the milieu poses serious challenges in illustration.
One illustrator who has confronted these problems head-on is David Goodsell, a structural biologist at Scripps.
His work is so good, and in my opinion so important, that I implore Dr. Tufte not to put
Beautiful Evidence to bed until Goodsell's work has been examined (if it has not
yet been). Goodsell's now got three books. Of the first two, I recommend The
Machinery of Life. It is already a classic. Goodsell has a third book out now,
Bionanotechnology: Lessons from Nature, that I've not yet read; I look forward to
it as I look forward to reading Dr. Tufte's own work.
-- Alex Merz (email)
|
|
Response to Mapped Pictures
I would like to second Prof. Merz's endorsement of David Goodsell's work (he also
authors and illustrates the enormously informative Molecule of the Month at The Protein Data Bank).
He works in two distinct yet complementary modes:
1. He creates unique
linear renderings of molecules based on depth maps produced by a molecular
modelling program (Rasmol). For some techniques to reproduce this approach, I have
made some hasty notes.
2. He creates pen and ink and watercolour paintings of the molecular "
mesoscale", where the shapes of biomolecules are simplified, and represented, as
much as is presently known, in their true scale, numbers and interrelationships in a
shallow cellular landscape. These latter are especially beautiful, and remind me of an
exquisite handmade quilt (there is a metaphor about the nature of biology to be extracted
from that last statement, though I am currently at a loss...).
I hope I have not derailed this thread with these references...
-- Nick Woolridge (email)
|
|
Response to Mapped Pictures
One more link. Here is a great set of small multiples that shows the power of
Richardson's ribbon representatons of protein folds.
-- Alex Merz (email)
|
|
Response to Mapped Pictures
A fine pair of mapped pictures comparing image methods for coronary arteries. From the New York Times, November 17, 2004, p. A24. Original source: Dr. Mario J. Garcia, Cleveland Clinic.
-- Edward Tufte
|
|
Response to Mapped Pictures
I'd support Olsen's contribution from Sept 9, 2004: photographic images and drawings are different, and need separate discussion. There seems to be several direction in how photos can be used:
(1) adding a layer of text labels and lines to photo;
(2) text labels and lines + some processing of the photo (reducing brightness, etc);
(3) drawing a diagram from the photo and showing it in pair with the unchanged photo;
(4) series--using a series of photos in evidentiary function;
(5) collage--using pieces of photos to build a compilation.
The first direction appears very limited and often produces unsatisfactory results. The last direction (montage) probably cannot be used as evidence in strict sense.
* The current opening image of the chapter appears somewhat problematic. Line drawing (the Spiderman?) here carries no explanatory function. The three characters are frightened by the drawing-like subject that is advancing on them. The image can be used to convey the claim that let photos alone (line drawings are bad) but not the opposite.
* One subgenre to be considered is Before and After Diet photos. My translation copy of Bill Phillips's Body for Life has many fascinating ones. The subtle manipulation commonly used is to clad the subjects into tighter shorts, better haircut, and broader smile in these After photos.
-- Priit P. (email)
|
|
Response to Mapped Pictures
"The current opening image of the chapter appears somewhat problematic. Line drawing
(the Spiderman?) here carries no explanatory function." Perhaps the lack of a specific function is the reason why it's used as a chapter opener --it
represents the concept of mapping, but leaves it's function and meaning open to
interpretation. As such I think the image does a good job. And although I wouldn't say it's
beautiful, it adds a bit of levity to a serious subject, while referencing photography,
illustration, and pop culture. I like how the mapped lines echo the actual structure of the
basket, but must bend and curve to follow the contours of Dorothy's face, arms and dress.
But the mapping lines are crude; the photograph by itself is a far better visual reference to
the bends and cuvres, as is evident by the fine shadows indicating the wrinkles in
Dorothy's dress. But the the problem with a photograph is that it doesn't give you data
points, which the green lines symbolize, and that dilemma -- what you see verses what
the numbers tell you -- is at the heart of much of Tufte's work. My guess is this was an
illustration for a story (circa 1985) about how computer animation is going to replace live
actors. Something else of interest is going on here. The use of photography, a medium valued for
depicting reality is being pressed into service to illustrate flights of the imagination
involving a live actor interacting with an anthropomorphic lion and talking robot. You
could look it at simply as 2 guys in Halloween costumes, but there is something more
going on in the way the effect blurs the disinction between illustration and photography.
But that's another discussion.
-- wwick
|
|
Response to Mapped Pictures
Abbreviations and labels
This is a rather belated comment on Niels Olson's posting of 11th October, which for some reason I didn't see until today.
Specifically, he said: in Geva's image, there's a trade off between abbreviation and putting the label close to the object. Compared to "F68", writing out "The 68th amino acid in the peptide sequence, a phenylalanine" would be more democratic, but would also require leader lines.
The tradeoff that he mentions is indeed real, but I'm surprised at how often illustrators prefer to leave a lot of space rather than expand their abbreviations. This isn't a fault in the example given, as most of the space is used, but it's quite common to find illustrations where the elements are labelled too cryptically, or not at all. However, even though there is certainly not room to write "The 68th amino acid in the peptide sequence, a phenylalanine" there would be room to write "Phe-68", with a gain in intelligibility. Everyone who works with protein sequences knows that F is phenylalanine, but the potential audience is wider than that, and for everyone who knows that F is phenylalanine there are probably 20 people who know that Phe is phenylalanine, and at least some of the extra 19 probably care (whereas the countless millions who don't know that Phe is phenylalanine probably don't care either).
The example of a protein structure illustrates another point (especially if contrasted with ET's dogs on 9th September). In order to be easily legible white text against a dark background needs to be either bold or at least set in a font that is naturally bold. Whereas the names of the dogs stand out nicely, the labels of the aminoacid residues look distinctly spidery.
-- Athel Cornish-Bowden (email)
|
|
Response to Mapped Pictures
I think the molecular graphics example in this thread raises an interesting point that is while not exactly on the topic of this thread is certainly related. Of the scientific illustrations presented in this thread, the molecular structure of haemoglobin is the only illustration on a dark background -- I discount the photograph of Crick and Watsons structure as just that, a photograph. In Envisioning Information, Prof Tufte moved a similarly computer generated graphic (A storm simulation rather than a molecular model) from a dark background to a light background with a substantial increase in clarity. I think a similar effect could be obtained here with an associated increase in ease of labelling. I believe this is a common problem in structural biology. The researchers use computer generated images for evaluation of the model, and of the supporting data, using a dark background to reduce display glare, but then only minimally modify this image for publication purposes despite the different needs of the print medium. Better ways to depict molecules in print exist and have already been mentioned. Jane Richardson's work on cartoon representations of molecules has been translated into software by Per Kraulis (Molscript). This program, commonly used, produces excellent illustrations in postscript mode using many illustrators tricks such as careful use of think and thin lines(c.f. Understanding Comics by Scott McCloud). Notably, in postscript output mode the program assumes a white background and the output has dark outlines around the ribbons to aid in distinguishing one helix or chain from another. Annotation may be done within the program of by importing this postscript file into an illustration package. Molscript did, however, take a step backward in it's most recent version providing only dark background "screenshots" in it's Encapsulated PostScript output (Actually a TIFF image in an EPS wrapper). This step was presumably taken so that images could be incoporated into MS Word documents and powerpoint presentations (Neither application handles postscript well). Using the postscript output now requires a conversion to EPS by a separate program before it is able to be included in a document. This is relatively easy and well worth the effort. I think that many structural biologists are trying to produce "photorealistic" images when no such reality exists to be photographed. The illustrations are of models, of carefully selected information to show what the author wants to you to see. The photorealistic approach may be an attempt to be more convincing. To draw attention <away> from the fact that what is shown is a model, to give the reader the impression that this is "reality". The analogy is that of a satellite photograph of a region and a map - the flawed molecular model image trys to be the photograph of what "it" looks like when it should concentrate on being the map of what we know. A related question then is how does the mapping of an illustration differ from the mapping of a photograph? How does the production process affect the subsequent mapping and is this a basis for choosing one over the other?
-- John Walker (email)
|
|
Response to Mapped Pictures
Jim Bumgardner's recent use of Flickr to plot the time of sunset during a year is a counter example to Priit P.'s assertion "(montage) probably cannot be used as evidence in strict sense." See the thread Images Used as Data Points.
-- Niels Olson (email)
|
|
Response to Mapped Pictures
Gloria Hopkins' essay on photographic composition includes some good examples of mapped pictures. In these cases, the purpose of the mapping is to explain in objective terms the attributes of successful compositions. The "maps" displayed are useful in fulfilling their purpose, and Gloria implements the technique well.
The diagrams are notable for another reason, though. "Escaping Flatland" is central to the ideas behind much of ET's work. These composition maps represent a way to help people enter Flatland -- they act as tools to help photographers visualize a three-dimensional (or more: consider that a photograph is not an instantaneous event, but has duration; there are numerous other dimensions in a photograph) image in two-dimensional terms.
-- Scott Zetlan (email)
|
|
Response to Mapped Pictures
I would like to add a mapped dog (mine, "Bella") to this collection,
although a more ambitious version would have included data about height and weight.
After having my dog sit long enough to be portrayed, exhaustion prevented further
scientific data recording.
-- Nicolas Bissantz (email)
|
|
Response to Mapped Pictures
This is a delight by our Kindly Contributor, Nicolas Bissantz, who
has also produced some super sparklines. Thank you. ET
-- Edward Tufte
|
|
I live in the city of Grenta, on the West Bank side of Jefferson Parish. I found one picture that claimed to be from Gretna, which was posted in an Australian newspaper. The best information I've been able to get is from text messaging into source in the city, the WWLTV parish-by-parish chat forums, and my classmates. On average there's on piece of information useful to me per page of WWLTV's Jefferson Parish forum.
Meanwhile, the Texas A&M School of Medicine is probably going to adopt me for the semester, I just have to buy books and catch up. They started two weeks earlier and I lost Saturday through today. Given that time crunch I can't afford to read the forums any more and I appreciate anyone's effort to aggregate good information. The national networks are worthless, but WDSU and WWLTV have some good content, though it is very repetitive. Thanks, Alex, for pointing out Kathryn Cramer's blog. Perhaps some sort of wiki could be established to aggregate and sort information about future disasters. Maybe a screen of time-series maps that can be "noted" like the pictures on Flickr.
More on my particulars at my blog. If you have information, particularly about Gretna, please contact me.
-- Niels Olson (email)
|
|
Niels, During the southern California fires of 2003, the best information came from extremely dedicated folks who stayed on the mountain, chasing after accurate information and posting it on a text-based community forum, very similar to your parish forum, I imagine. Even the official postings from governmental agencies were at least 4 or 6 (and often more) hours behind our little web forum, with less complete information. I think the work of Kathryn Cramer and the contributors to her blog is absolutely wonderful, but given the dearth of information getting out, that kind of geographical gumshoe work just takes too long. In a quickly changing situation, such maps will generally be obsolete by many hours when complete. A quick set of maps, even hand drawn, showing specifics of the flooding and other damage will be very helpful, but preparing these will be difficult unless you're on the scene and can also get the information out. The best way to get information out to those most affected is to tell it to them, or type it out and post it; our spoken and written language has the highest information resolution and should be used with specificity, especially in such drastic circumstances. "Speak the truth" is no mere slogan and can really help those in need or wanting to find out about their town or loved ones. Once people get good information, they'll make astute assessments of their situation and take concrete action to help themselves, their families and others. All of the news services, local and otherwise, were as worthless here as you've experienced in Louisiana in the past few days. During the fires, three different local TV stations once simultaneously showed the same building burning spectacularly, yet each station identified it as being in a different town. Stuff like this went on for the duration of the fires. I've seen no improvement during the Katrina disaster. Forgive my curmudgeonism, but they should all be ashamed of themselves. There's an Ask E.T. thread on the fires: http://www.edwardtufte.com/bboard/q-and-a-fetch-msg?msg_id=0000tY&topic_id=1 My best to you and your family.
-- Steve Sprague (email)
|
|
ET-
An interesting Feature story about paleoclimatology can be found at NASA's Earth
Observatory web site. http://earthobservatory.nasa.gov/Study/Paleoclimatology Near the bottom of the story page is one of Louis Agassiz's drawings showing various
glacial features. The drawing has been modified so that one can sweep the cursor
over the illustration to activate a line drawing overlay, which conveniently identifies all
of the relevant geological features with direct labels. By the way, NASA's Earth Observatory is a wonderful web site with an assortment of
useful, high-resolution satellite images, which are periodically updated.
Quite nice. http://earthobservatory.nasa.gov
-- Daniel Meatte (email)
|
|
The white background in the boxes should be somewhat transparent; the black outlines
around the boxes should be omitted. The annotation is thin, the equivalent of a couple of
paragraphs in a story. And why the map? It is not very helpful and is covered up by the
boxes anyway. A much better way to do all this, at least on a newspaper page with more space and better
resolution than a televison computer screen, is to place much more annotation
surrounding the map, with light pointer lines then crossing over the map to the relevant
area. With more annotation, perhaps some of dynamics of what happened could be
indicated. This method would also make use of a newpaper's great advantage--lots of
high-resolution space within the eyespan.
-- Edward Tufte
|
|
 This Roman mosaic from a villa in North Africa commemorates a venatio—a show of simulated hunting—paid for by the villa's owner. The performers are professional touring beast-fighters called venatores, who are shown killing captured North African leopards. There appear to be labels naming not just the venatores but also the leopards they dispatched. The figure in the centre carries a tray bearing bags of money, and the text surrounding him describes the performers' request for payment. (clicking on the image produces a much better version from a different site, but beware, it's 2.8 megabytes)
-- Derek Cotter (email)
|
|
Excellent, especially the full image.
-- Edward Tufte
|
|
Here is an example of annotations in different cultures and
a free tool allowing annotate and share digital images. I hope it can be interesting to you and the community. I'd be glad to hear your feedback, especially if you consider the tool useful or have any comments or improvement suggestions. Thanks!
-- Alex (email)
|
|
Notice that none of the examples above have Post-It-like color fields containing the type. Most examples in the proposed tool, however, are demonstrations of Post-It labeling, word boxes covering images, not examples of words working with images. Use then, at a minimum, more subtle transparent fields to hold the type on the image. Overall there needs to be much greater design and typographic subtlety in the proposed tool. Putting Post-It notes on existing images maintains the unfortunate segregation of text and image.
More generally, the tool is driven by a programming solution rather than by ideas about text and image together. Substantial theoretical statements, with many examples, about words and images together are:
Meyer Schaprio, Words and Pictures: On the Literal and Symbolic in the Illustration of a
Text (1973).
Meyer Schapiro, Words, Script, and Pictures: Semiotics of Visual Language
(1996).
Edward Tufte, Visual Explanations: Images and Quantities, Evidence and Narrative
(1997), 120-151.
Edward Tufte, Beautiful Evidence (2006), 82-121.
That's your reading assignment before continuing further.
-- Edward Tufte
|
|
We wrestled with the label/mapping problem when creating a new series of meridian charts for use by students, teachers and practitioners of TCM based modalities such as acupuncture and shiatsu. Such charts are characterised by complex meandering linework which, in accord with the esoteric nature of TCM, is coloured according to the Five Element theory. Most other charts used artistic renderings which allow easier control of the interplay between scale, depiction of anatomical features and labelling. In our pursuit of realism (accuracy and veracity) we chose to markup a student and photograph him. Issues with scale, skin colour, mixed contrast lighting, skin reflection and stubble became real stumbling blocks.
Most often the labelling of specific points and features in drawings is accomplished both within and without the image outline. In our case we were cognizant of the 'lifecycle' that such charts have in the hands of a typical student who progresses from close study to a working practitioner. By the end of that cycle, at best the chart is hanging up in the waiting room, shocking the patients. By placing all labelling inside the body outline we were able to preserve the aesthetics of the imagery when viewed from a distance and hopefully have a calming, if not pleasing, effect on the viewer.
 Click through to a closeup of the legends.
In the three images below you can see firstly the simple linework of the TCM, next the 'heretical' "zen extensions" of Shizuto Masunaga, and then the TCM and Zen linework combined. The majority of information is carried by the colouring, opacity, thickness, layering and, in some cases, patterning of the linework. On the combined chart it must also show where Masunaga agrees or disagrees with TCM orthodoxy. Sometimes it must also explain why. Labelling per se is restricted to the points, some of which have special roles, and are colour coded accordingly.  TCM
 Masunaga's Zen extensions
 Combined TCM and Zen extensions
-- Lee Rydstrand (email)
|
|
Here are some sketches for mapped images as an overall design strategy for books and computer screens, at least for highly visual material that is first revealed and then explained.
Below, in Bouquet, some good edge-play in the light cast onto the element at left.
Note the Necker Illusion in the vertical fold, which reads as both folded-in and folded-out
in relation to the viewer. Multiple edges cast light to the left of the vertical; those
edges themselves appear folded, this way and that way, depending up the reading
convention applied by the viewer to the image.
Immediately above is an experiment in mapping images with detailed text. The idea
is to pair an image without annotation followed by the same image annotated. Let the
viewer explore, then point the viewer to particular elements in the image.
Could a book (or computer screens) be written in this format of direct captioning? Words that discuss the overall image would be in
the usual format of text--sentences and paragraphs--but words that discuss local detail
would be placed right on the image itself. This would finesse the problem of finding
the detail and would illustrate directly what a close look at the image can reveal.
Perhaps the sequence of the unannotated image preceding the annotated image
accommodates both unguided exploration followed by guided analysis. This is similar to
the usual teaching technique: show something and ask "what do you see," then encourage
a closer look ("use the little gray cells" as Agatha Chritie's Hercule Peroit probably said),
finally followed by showing what a close (annotated) look can in fact reveal.
-- Edward Tufte
|
|
How would it work in the book? Would the annotations be added
using a transparency? Would they be facing pages? Would they
be in the same location on different two page spreads? Each scenario might influence the way that the reader scans the two images. I am not sure that I could look at the former without glancing at the latter unless it was hidden from view. Another intersting element of this image is use of arrowheads and the angles of the lines.
-- Tchad (email)
|
|
Annotated (but not scaled) astronomical picture
Today's Astronomy Picture of the Day is from last week's lunar eclipse. I've seen multiple exposures across the sky many times, but always against a fixed azimuth and altitude. Because these take many hours of the night, the picture shows a very long sequence in terms of moon diameters. This one is a multiple exposure against the fixed star background, and the moon travels a much smaller distance across that (approximately 1/28 as far, i.e. in the ratio of about one day to one month).
The map of the sky is nicely labelled, with the zodiacal constellation of Leo marked up and named, and the ecliptic drawn in, with a circle where the Earth's shadow is, showing the moon entering and leaving it. Saturn is also pointed out, in its current position on the ecliptic. I wish the ecliptic and the shadow circle had not been such a dark blue, as it's very hard to see on my CRT monitor when it's at a comfortable setting. I'm also prompted by the Ask E.T. discussion on the subject, to feel more and more annoyed by the absence of a scale in degrees for these pictures. I happen to know the Moon is about half a degree in diameter, but still.
-- Derek Cotter (email)
|
|
Sorry, I meant to show the smaller image,
tle070303_legault_legend_auto800.jpg (800×518, 72 KB)
rather than the larger,
tle070303_legault_legend.jpg (1,096×730, 251 KB)
which is actually less sharp, for all that it's bigger.
-- Derek Cotter (email)
|
|
Here's a version I altered myself, which I hope shows the blue lines more clearly.
-- Derek Cotter (email)
|
|
The lens of the human eye yellows with age. Yellow opposes blue, with the consequence that seeing blue on black is increasingly difficult with age. Out of sympathy for those of us with aged eyes, may we never annotate with blue on black (or black on blue).
-- Dan Dill (email)
|
|
There are many other such claims made by small subgroups of users about color design:
the 5 (or is it 7?) types of color deficiency, various needs for certain contrast ratios, and so
on. Then, in practice, these colors pass through all sorts of computer monitors (some
adjusted properly, and many not) with all sorts of varying color renditions and contrast
ratios. Accommodating some special interest claims may require, for example, glaring
colors and high figure-ground contrast ratios, which have substantial costs (high contrast
ratios lower the resolution of the information and also may result in eye fatigue during
extended use). Unaccommodated special interests seek to regulate design by means of legally mandated
standards, which may result in lowest common denominator design or in blocking
innovative designs. Sometimes those standards accommodate both deserving and non-
deserving claims. Probably most professional GUI designers can provide horror stories
about how mandated special interest standards have corrupted good design. One such
story, possibly apocryphal, was that the brilliant NeXT computer could not be sold in
Europe because it was black (rather than computer-plastic tan) and thereby in failed to
meet ISO standards (European GUI standards, some years ago, were written by a German
veterinarian who was the low bidder for the standards-writing contract). Big computer
companies sometimes dominate the standards-writing committees and use their
domination to raise entry costs for small innovators. In turn, a standards consulting
industry and standards departments proliferate--as a special interest for special interests
becomes a bureaucratic career--adding one more thumbprint on the design and one more
approval. And bureaucratic regulation has failed to solve a notorious color design issue:
the red/green traffic light. The design issues are quite likely to be more subtle than the special interest and
regulatory standards imagine. This is in part because design elements interact and are
intensely multivariate, but special interests and standards are univariate. Excellent design
has a hard time surviving interest group politics and centralized bureaucratic bloat. What to do? First, consumers can often come up with strategies to manage their special difficulty on
their own. Thus wearing glasses by some avoids forcing giant type on the many. Also
much can be done by user adjustments of their own computer monitor. Furthermore, the
individual user is already likely to be an expert in making her or his necessary
adjustments. Now and then, the designer might provide tips to various special interests to
help them better use the design. Second, market rather than regulatory solutions may yield some mutual adjustment
between the designer and the special interest. Third, designers should carefully distinguish between deserving and undeserving special
interest claims.
Fourth, designers should of course try to accommodate the deserving special-interest
claims without compromising the design for the many and without imposing costs on the
many. The spirit of the designer should be a generous respect for deserving special
interest claims accompanied by an evaluation of the opportunity costs (and the transfer
payments from one class of users to another) of satisfying those claims. Realizing this
spirit in practice may be difficult. (Re the example in the contribution above: I like the blue line, although it might be one
small step lighter. Perhaps some clever anti-aliasing can help here. Little contrast between
figure and ground is necessary to indicate a line. If the line becomes at all light in color it
will glare and flare. Since little contrast is need to specify a straight line, and more contrast
to specify type, the standards committee is already over its head, or at least has gone to
the dogs.)
-- Edward Tufte
|
|
To improve conformity across different displays, embed an ICC color profile in images
exported from Photoshop. It's not perfect, but it helps. Unfortunately I don't know a good reference for further information.
-- Rob Simmon (email)
|
|
A mapped photograph of the geologic boundary between the Neoproterozoic and the Cambrian:
The shale is younger than the limestone, and the contact between the two occurred at or
near the beginning of the Cambrian, when complex, multi-cellular life became
commonplace.
-- Robert Simmon (email)
|
|
Kernel Summit 2007
A number of fairly famous contributors to the Linux kernels are identified here. The photo is from lwn.net.
-- Niels Olson (email)
|
|
Dear ET Here is a fantastic self mapped image of Eric Darnell throwing a foam boomerang with built in LED's. The image uses the person as an implicit scale and in a non-verbal way shows the complexity of the boomerang trajectory. I loved it. Matt (http://tinyurl.com/yvekbp)
-- Matt R (email)
|
|
Wainwright Guides to the Fells. Dear ET, I just realised by searching the forum that you have never mentioned the famous Alfred Wainwright. I think your readers would very probably appreciate a very famous series of hand drawn walking guides to over 200 individual walks in the "fells" and hills of the English Lake district (Beatrix Potter country). These were made by Alfred Wainwright who lived in the lake district and was a passionate walker. They are superb examples of data integration. They include (all hand drawn) text descriptions of the walk, views from the start, views from the summits including angular arrangement of key features visible and distances, topographic information, maps, personal commentary and humour etc. A typical (but by no means the finest) image is shown on Wikipedia (http://tinyurl.com/2zqmtt). His book series (A Pictorial Guide to the Lakeland Fells: being an illustrated account of a study and exploration of the mountains in the English Lake District) is still in print and over 2 million copies have been sold. The books were made by him to be used as the walker progressed through the walk and are therefore very nice examples also of "Instructions at the point of Need". A nice collection of Wainwrights own favourite walks has been published recently (see Amazon.co.uk = http://tinyurl.com/3y56tz including some nice "Look Inside pages"). Best wishes Matt
-- Matt R (email)
|
|
dead trees mouseover
By printing the labels on something like waxed paper, the ingredients in this cookbook can be viewed with or without
mapping. Source:
Ma, Nancy Chi. 1960. Mrs. Ma's Chinese Cookbook. Rutland, Vermont, and Tokyo: Charles E. Tuttle Publishers. (28th
printing, 1972) 
-- Nathan Vander Wilt (email)
|
|
-- Edward Tufte
|
|
Here's a lamp, a giant lamp, at a recent auction:
Source: Sotheby's Important Postwar & Contemporary Design, New York, November 16, 2007, 132-133.
-- Edward Tufte
|
|
For a few versions now, Adobe Acrobat has supported layers and linking. My team has taken to using this feature to make user-selectable overlays available in portable electronic documents, specifically for images of small mechanical assemblies, extracted from larger parts, shown in cross-section. These small parts are mounted in epoxy, then sectioned and polished, and finally imaged on an optical microscope. We first present a macro image of the entire cross section, then place overlays with links to higher magnification areas of interest. The "button" layer can be toggled on or off by the user. The layers typically contain information about damage and quantitative measures of the constituent materials. With the advent of Acrobat 3D, we can now extend this approach to a wireframe or other solid model, allowing the viewer to see layers of information which compares the actual (photograph) to the ideal (3D model). The 3D model is selectively overlain to the micrographs, and can be rotated and even disassembled in the Acrobat reader. This makes conformance and deviations of the part quite clear. It also allows the viewer to gain better perspective of the assemblies, and how they fit into the larger part. This is not strictly an example of a diagrammed or mapped picture, but instead a moment beyond which allows the viewer to interact with an arbitrary combination of data in a single screen.
-- S. Valentine (email)
|
|
Dear ET, Here is a nice example (http://www.ericson.net/content/2009/10/how-big-is-that-phone/) of how to scale an object of interest (a mobile phone) by showing it next to other well known objects; an iPod, a pack of playing cards and a pad of Post-It notes. This also acts as a link to the blog of Matthew Ericson (http://www.ericson.net/content/) the the deputy graphics director at The New York Times, where he manages a department of journalists, artists and programmers who produce the interactive information graphics for nytimes.com, as well as all the graphics for the print newspaper. He has some nice maps and interactives graphics - his multi-decade analysis of the #1's of Michael Jackson is also interesting (http://www.ericson.net/content/2009/06/the-king-of-pop/) Best wishes Matt R
-- Matt R (email)
|
|
Dear ET, here is an extensively mapped image database of Trajans column (http://cheiron.mcmaster.ca/~trajan/index.html). The site maps the continuous spiral layout of the column's artwork with cartoons that have annotations and links to high resolution images. The navigation allows you to move up and down the column and see either individual panels or a whole spiral piece around the column at a particular height. The image below shows the navigation mechanism. Best wishes Matt 
-- Matt R (email)
|
|
Response to Self-Mapped pictures
Under the heading 'Self-Description' Randall Munroe has a very thought provoking comic strip that is a visual pun on fixed point theorems, i.e. a function f that has at least one fixed point, a point x for which f(x) = x. I think. Here http://xkcd.com/688/ Matt
-- Matt R (email)
|
|
Hello,
I think this page should be noted. It explains how to identify and check the EGR valve on a '96 Lexus.
One of the pictures is attached. The series of pictures might be better if put together, but because of the
structure of the forum site, it was probably difficult to do. Still, the text is between the images and is simple and to the
point. I note this because there were several literal step by step explanations of this process that were clear but
without pictures it is difficult to know what the writer is talking about. In general, mapped images would be VERY
helpful when doing this type of car work. The engine manuals that I've come across have pictures, but they are difficult
to follow even though the text is adjacent to a picture. The moral of the story; auto mechanics should learn the
Photoshop text tool. Matt http://clublexus.com/forums/es300-and-es330/302017-p0401-egr-flow-insufficient-how-to.html
-- Matt Flynn (email)
|
|
Here is an example page spread from the very extensive range of DIY car maintenance manuals designed and sold by Haynes (www.haynes.com). They make extensive use of mapped pictures, integrated text and images and instructions at the point of need. The example below is from one of their manuals for a 2004 3-series BMW. Best wishes Matt R 
-- Matt R (email)
|
|
Readers may like to know about the Isotype revisited project.
This interesting research project traces the history of the Isotype. It draws on the Otto and Marie Neurath Isotype Collection at the University of Reading; which, judging by the images available on the project website, offers a rich and valuable source for understanding modernist approaches to visual communication, graphic design, and information visualization.
-- Catherine Howell (email)
|
|
I came across this mapped image of Christmas songs which reminded me of some of the pieces
in your books "How to Look at Modern Art in America" and other relational diagrams of
various themes. As described by the author, the work is a "cartography of traditional and
contemporary songs, depicted with excruciating attention paid to scale relationships between
the songs, their meanings, and resulting locations." I found the humorous work's attention
to design pleasing to look at and enjoyable to appreciate the correlations between the
various Christmas songs. http://www.dennischeatham.com/wordpress/wp-
content/uploads/2010/12/Christmas-Songs-Map.pdf
-- Dan Aust (email)
|
|
| Threads relevant to analytic design: |
|
|
|
|
|
_jpg.jpg)
