"More Eyeballs on AERS"

That's what the Nature Biotechnology editors titled it.

Our correspondence to Nature Biotech regarding AERS data came out yesterday. I can't post the article due to copyright restrictions, but I'm sure you can pick up a copy at your local newsstand.

Warning Letters Update: FDA makes 1 fix

FDA has fixed the "beef northwest" issue described in yesterday's post (i.e. if you search for warning letters for "beef northwest" the search engine now returns 1 result (click here for same link as yesterday, but now with correct result).

I don't yet know whether all of the missing warning letters have been restored, but it's a start.

Where have all the warning letters gone?

I’ve written a couple of posts on FDA Warning Letters (here and here), but today’s post seems particularly important.

The FDA’s Warning Letter Search Engine is Seriously Flawed.
There are at least 2 things that are wrong (in addition to the flaws I outlined earlier).

• Certain warning letters that were in the old database have vanished.
• The warning letters that are returned when searching by date are often inaccurate.

Allow me to elaborate.

Certain warning letters that were in the old database have vanished If you use the FDA’s Warning Letter Search engine to search for “beef northwest”, you get 0 (zero) results [update: fda has fixed this error--see here]. But there is a warning letter issued to Beef Northwest Feeders LLC issued on August 21, 2007 (see here for the letter). You can also search the FDA’s Warning Letters by Company Name and the record does not show up.[update: fda has fixed this error--see here]


By my estimate there are almost 2,000 missing warning letters (I wrote a small bot that systematically went through the current FDA search engine and recorded warning letter results issued every day from January 1, 1996 to the present day and it returned ~7,700 warning letters, whereas the FDAble Warning Letter Database, made from the FDA’s old search engine, contains ~ 9500 letters).

Warning letters returned when searching by date are often inaccurate If you use the FDA warning letter search engine to search for all warning letters issued from 11/1/1996 to 10/31/1997 you get 152 results.

If you expand your search by 1 day (11/1/96 - 11/1/97) you get 876 results. Here’s a hint: The FDA did not issue 724 warning letters on 11/1/97- it was a Saturday.

I don’t know why the first search yields only 152 results, but it’s clearly wrong, and to be honest, given the errors throughout I’m not confident in the 876 results returned in the 2nd search-The FDAble database says there were 1,008 warning letters issued from 11/1/96 and 11/1/97.


To summarize all 3 posts we have the following problems with FDA Warning Letters Search Engine.

1. Certain warning letters that were in the old database have vanished.
2. The # of warning letters returned when searching by date is often inaccurate.
3. Warning Letter Responses also appear to be missing from the new database.
4. Downloadable Results are presented as Excel files, but are actually HTML.
5. Warning Letter results return a maximum of 1,000 records, but this limit is not explicitly noted on the web-site.

I have an email in to FDA asking them to repair and notify others who may have been led astray.

FDAble's Side Effect Check now available in iTunes App Store

Can be had here.