Correction
Hazard Is Not Risk: How to Read Any Ingredient Score
- The claim
- “A high score in an ingredient checker means the product is dangerous.”
- The short answer
- No. It measures hazard — whether a substance could cause harm under any conditions. Risk depends on dose, formulation, rinse-off versus leave-on, exposure site and frequency. A score that ignores all five is an index into the literature, not a verdict.
- Evidence status
- Settled — the distinction is written into the European safety-evaluation procedure, and EWG's Skin Deep states on its own methodology page that its rating does not account for exposure.
1. Two words that are not synonyms
Hazard is a property of a substance. Risk is a property of a situation. The European Commission's Scientific Committee on Consumer Safety builds its procedure on that gap: a safety evaluation comprises four elements, the first being hazard identification, “carried out to identify the intrinsic toxicological properties of the substance, i.e. whether it has the potential to damage human health”. The other three are exposure assessment, dose–response assessment, and risk characterisation, in which a Margin of Safety is a point of departure divided by the Systemic Exposure Dose.1 Exposure sits in the denominator; identity is not in the equation at all.
The Committee's own worked example: “A cosmetic substance that has the intrinsic property to be corrosive is not necessarily excluded for use in cosmetics. An example is potassium hydroxide KOH, the corrosivity of which depends on the final concentration, the pH, the presence of ‘neutralising’ substances, the excipient used, the exposure route, etc.”1 KOH is a hazard in every jar it has ever been in. Whether it is a risk is settled by the five variables that sentence names, plus an “etc.”, and no ingredient name carries any of them. A number from step one alone has done a quarter of the work.
2. Dose makes the poison — and what that does and does not excuse
The maxim is load-bearing, and it is the thing toxicologists say the press handles worst: in a 2009 survey of Society of Toxicology members, 96% rated media performance as poor at explaining that “the dose makes the poison”, against 3% rating it well.10
What it does not excuse is treating a limit, once set, as a permanent verdict. Until 11 February 2017, Annex V entry 57 allowed methylisothiazolinone at 0.01% in any cosmetic product, leave-on included. A regulation of 22 July 2016 cut leave-on out and kept 0.01% for rinse-off, applying from 12 February 2017.4 Less than twelve months after that regulation, on 6 July 2017, the Commission cut the rinse-off figure again by nearly seven-fold, on an SCCS opinion of 15 December 2015 concluding “that for rinse-off cosmetic products, a concentration up to 0,0015 % (15 ppm) Methylisothiazolinone is considered safe for the consumer from the point of view of induction of contact allergy”:3
In Annex V to Regulation (EC) No 1223/2009, entry 57 is replaced by the following:Commission Regulation (EU) 2017/1224 of 6 July 2017 amending Annex V to Regulation (EC) No 1223/2009 on cosmetic products, Annex, entry 57. OJ L 174, 7.7.2017, pp. 16–18. Columns a to g of a nine-column table, each set here under its own heading; h and i are empty for this entry. Still the text in force: the consolidated Regulation of 1 May 2026, CELEX 02009R1223-20260501, carries entry 57 in these terms, read 2026-08-06.13
Reference number — 57
Chemical name/INN — 2-Methyl-2H-isothiazol-3-one
Name of Common Ingredients Glossary — Methylisothiazolinone
CAS number — 2682-20-4
EC number — 220-239-6
Product type, Body parts — Rinse-off products
Maximum concentration in ready for use preparation — 0,0015 %
Three positions in under three years — 0.01% anywhere, 0.01% rinse-off only, 0.0015% rinse-off — on chemistry that never changed. What changed was the estimated dose at which induction of allergy occurs. (Entry 39 carries the same 0,0015 % figure for a 3:1 mixture with methylchloroisothiazolinone, and the footnote to entry 57 makes the two entries mutually exclusive: a product may use one or the other, never both.12) Nor is “more is always worse” universal: the SCCS records non-monotonic dose–response curves — meaning the effect does not rise steadily with the dose but can peak and fall away again, tracing a U or an inverted U — as an observed phenomenon.1 The maxim licenses attention to the dose, not the conclusion that a permitted ingredient is settled for good.
Which raises the obvious question, since dose is what decides this: can you read the dose off the pack? Almost never. The order rule on an ingredient list tells you less than it appears to, and what it can and cannot tell you is worth knowing before you try to score anything from a label.
3. The variables a score throws away
Two rows of the SCCS exposure table. Shampoo: 10.46 g applied per day, retention factor 0.01, calculated daily exposure 0.11 g. Body lotion: 7.82 g per day, retention factor 1.00, calculated daily exposure 7.82 g.2 The retention factor exists “to take into account rinsing off and dilution of finished products by application on wet skin or hair”. The same ingredient at the same percentage therefore differs about seventy-fold between those two products in the amount left on skin per day — and a score attached to a name cannot move between them, because the name has not moved.
EWG's Skin Deep — a database of ingredients in over 100,000 products, built by comparing labels against “nearly 60 toxicity and regulatory databases” — says so in its own methodology: the hazard rating “considers potential health hazards but does not account for exposure or individual susceptibility, factors which will drive health risks, if any, but which are generally not available for assessment”.8 The disclosure is on the page. The failure is in the reading.
There is an inversion worth naming too. In that methodology the hazard category “use restrictions” — “prohibited for use in cosmetics, or subject to concentration, use, or manufacturing method restrictions, according to industry safety guidelines and government requirements and guidance from the U.S., E.U., Japan, and Canada” — carries a weighting factor of 0.9, behind only the six categories weighted 1.0.8 Writing an exposure limit is risk management, and the act reduces risk. Fed into a hazard score it raises the number. Entry 57 above is exactly such a restriction.
4. What a data-gap penalty does to a new, well-characterised molecule
“Every product and ingredient in Skin Deep® gets a two-part score – one for hazard and one for data availability.”9 The second is reported as none, limited, fair, good or robust, and half of it is arithmetic on a literature search: “The remaining 50 percent reflects the number of studies listed for that ingredient in the government's PubMed scientific research index.” The band table runs 0 or 1 study → 0; 2–100 → 1; over 100 → 2; over 1,000 → 3; over 10,000 → 4, and the ceiling is anchored by example — “well-studied ingredients are set at 4 (formaldehyde, benzene and other ingredients with higher ratings than these two)”.8 A molecule introduced in the last decade with a complete modern dossier — read-across, in silico prediction (computer modelling from structure), an OECD-guideline test battery, an SCCS opinion — can return a hundred indexed papers or fewer under its INCI name and score 1, “limited”, on that half of the rating. Not because less is known, but because less has been printed under that name.
The Cosmetic Ingredient Review refuses to compress the same problem. Its procedures define safety such that “a lack of information about an ingredient shall not be sufficient to justify a determination of safety”, and one of the Panel's four conclusions is insufficient data, on which it “does not state whether the ingredient is safe or unsafe”; the other three are safe as used, safe with qualifications and unsafe.56 Where use is reported and the data never arrive, the classification becomes after two years “Use Not Supported by the Data and Information Submitted to the Expert Panel”.5 That is a statement about a file rather than about a molecule, and a 1–10 axis cannot make it. On who pays, CIR's about page reads: “Although funded by the Council, CIR, the Expert Panel for Cosmetic Ingredient Safety, and the review process are independent from the Council and the cosmetics industry.”7
5. The survey everyone cites, and nobody reads properly
“79% of toxicologists say the Environmental Working Group overstates the risks of chemicals” is an accurate sentence and the least interesting line in its table. Here is the whole column, in the order printed: Greenpeace 96%, Environmental Defense Fund 85%, PETA 80%, Environmental Working Group 79%, Natural Resources Defense Council 79%, Center for Science in the Public Interest 79%, EPA 41%, CPSC 36%, WHO 31%, NIEHS 29%, NIOSH 29%, OSHA 28%, the International Agency for Research on Cancer 28%, AMA 28%, FDA 22%, National Cancer Institute 21%, CDC 17%, USDA 12%, National Science Foundation 11%, FASEB 10%, the Society of Toxicology itself 8%, ASPET 7%, PhRMA 2% and the American Chemistry Council 2%.10 A quotation that keeps the 79% and drops the 17% has converted a spread into a verdict.
The denominator matters more than the spread. Those percentages exclude respondents who answered “not sure”, because familiarity with the organisations varied so widely that leaving them in would, the authors wrote, stop the comparisons being “commensurable”; the newsletter reprints that caveat in a footnote and records that the full report gives the calculation both ways.10 It does, in a second chart, and the second chart reorders the list: with “not sure” counted in the denominator, Greenpeace falls to 83%, the Environmental Defense Fund to 61%, and the Environmental Working Group to 40% — one point above the EPA's 39%.14 The 79% that gets quoted is the figure among the minority of toxicologists who had an opinion about the group at all.
The rest of the methodology deserves the same treatment. Between 27 January and 2 March 2009 the Center for Media and Public Affairs, STATS and the Center for Health and Risk Communication at George Mason University contacted 3,562 full members of the Society of Toxicology, using an online instrument administered by Harris Interactive; 1,136 responded, a 32% return rate, and the published percentages rest on the 937 who answered every question.11 It is a survey of professional opinion about organisations, not a measurement of any ingredient, and it was fielded seventeen years ago.
6. How to use a score properly
Treat it as an index. A high number means something has been written about the molecule in one of the nearly sixty databases behind the score; follow it to the finding and read four things — the endpoint, the species, the dose, the route. Then ask what the score cannot: does this product hold the ingredient against skin for sixteen hours, or send it down a drain in ninety seconds? EWG's own advice is to read both axes at once, buying “products with lower hazard ratings AND at least ‘fair’ data availability”.8 Used as a verdict, a score is step one of four wearing a number.
7. Why this site publishes no score of its own
Any single digit does one of two things. It encodes exposure assumptions — how much, how often, on which body site, rinsed or left on — which for products we have not opened we would have to invent; or it drops them, at which point it is a hazard score again. A rating also implies a comparison across products, and this site does not test products. And numbers outlive their reasoning: entry 57 read 0,01 % and then 0,0015 %, and only the citation makes the change visible. What we publish instead is the limit, the conclusion and the study, with the document attached — the method is at How we source.
8. Four questions to ask of any score, including ours
What is measured — a property of the molecule, or of the exposure? If the method never mentions concentration, product type or frequency, it is hazard.
Can you reach the underlying finding in one click, with dose, species and route? A source named but not linked cannot be checked, and that failure is as available to this site as to any other.
What does the system do when data are missing? It can emit a low number and warn separately, decline to conclude, or say the file is incomplete. Watch which.
When was the source data last refreshed, and is that date printed? Ours is at the top of this page as “Last checked”. Where a source carries no such date, it is recorded immediately below.
What we could not verify
The live EWG methodology pages. ewg.org/skindeep/contents/about-page/ and ewg.org/skindeep/understanding_skin_deep_ratings/ returned HTTP 403 to every plain fetch attempted on 6 August 2026. Every quotation attributed to them above comes from Internet Archive captures — 26 February 2024 and 17 December 2023 — and we could not verify that the live text is identical today.
When the Skin Deep database was last refreshed. The methodology page dates its own listed sources from 1987 to 2012 — most of them 2005 to 2007, and including IARC Monographs volumes 1–88, the CIR Compendium and a 2012 PubMed pull — and dates the data availability rating to “the April 2011 release”. It carries no revision date we could find, so we cannot say when the underlying hazard data were last updated, and the 2024 capture we read is the newest text we have.8
Where the score bands sit. The same page states that hazard ratings appear in “low”, “moderate” and “high” bands on a 1-to-10 scale, and that 10 goes to the top 5% most hazardous entries. It does not print the boundaries between the three bands, and we could not find them stated anywhere else, so we cannot tell you which number turns “moderate” into “high”.8
Sources
- Scientific Committee on Consumer Safety. The SCCS Notes of Guidance for the Testing of Cosmetic Ingredients and their Safety Evaluation — 12th revision, Corrigendum 2. Adopted 15 May 2023; corrigendum 1, 26 October 2023; corrigendum 2, 21 December 2023. Section 3-1, pp. 11–13 (the four elements of a safety evaluation, and the Margin of Safety equation on p. 13); section 3-1, p. 12 (non-monotonic dose–response, Figure 2); section 3-4.5.1, p. 56 (potassium hydroxide). Read 2026-08-06. SCCS/1647/22 ↩
- Scientific Committee on Consumer Safety, Notes of Guidance, 12th revision, section 3-3.4.2.1, Table 3A, p. 27 — daily exposure levels for cosmetic product categories in Europe. Shampoo: q 10.46 g/d, f_ret 0.01, E_product 0.11 g/d. Body lotion: 7.82 g/d, 1.00, 7.82 g/d. Amounts are P90 values from Hall et al., 2007 and 2011; retention factors derive from SCCNFP/0321/00. SCCS/1647/22 ↩
- Commission Regulation (EU) 2017/1224 of 6 July 2017 amending Annex V to Regulation (EC) No 1223/2009 of the European Parliament and of the Council on cosmetic products. Recital (2) and Annex, entry 57. OJ L 174, 7.7.2017, pp. 16–18. CELEX 32017R1224 ↩
- Commission Regulation (EU) 2016/1198 of 22 July 2016 amending Annex V to Regulation (EC) No 1223/2009 — entry 57, Methylisothiazolinone, rinse-off products, 0,01 %; compliance from 12 February 2017. OJ L 198, 23.7.2016, pp. 10–12. CELEX 32016R1198 ↩
- Cosmetic Ingredient Review. Cosmetic Ingredient Review Procedures & Support to the Expert Panel for Cosmetic Ingredient Safety, December 2025. Section 1(m) (definition of “safe”), section 2 (purpose), section 42 (determinations), section 46(a)(1)–(3) (classification of ingredients with insufficient data). cir-safety.org · CIR Procedures, December 2025 ↩
- Cosmetic Ingredient Review, “How Does CIR Work?”, consulted 6 August 2026 — the four conclusions available to the Expert Panel, in the page's own words. Safe: “Ingredients safe in the practices of use (product categories) and concentrations of use for each product category as documented in the safety assessment.” Safe with qualifications: “The Panel may reach the conclusion that an ingredient can be used safely, but only under certain conditions.” Unsafe: “These are ingredients with specific adverse effects that make them unsuitable for use in cosmetics.” Insufficient data: “If the Panel reaches an ‘insufficient data’ conclusion, it does not state whether the ingredient is safe or unsafe.” cir-safety.org/how-does-cir-work ↩
- Cosmetic Ingredient Review, “About”, consulted 6 August 2026 — the funding sentence quoted above. “Council” is defined in the Procedures, section 1(j), as the Personal Care Products Council. cir-safety.org/about ↩
- Environmental Working Group, “The science behind the database” — the Skin Deep methodology page at ewg.org/skindeep/contents/about-page/. Sections “Skin Deep's dual rating factors”, “Hazard ratings”, Table 1 (hazard categories and weighting factors), Table 10 (data availability from the open literature) and “Data availability ratings”. The live page returned HTTP 403; quoted from the Internet Archive capture of 26 February 2024. web.archive.org/web/20240226142749 ↩
- Environmental Working Group, “Understanding Skin Deep ratings”, at ewg.org/skindeep/understanding_skin_deep_ratings/ — the two-part score and the 1-to-10 hazard scale. Live page returned HTTP 403; quoted from the Internet Archive capture of 17 December 2023. web.archive.org/web/20231217110403 ↩
- Center for Media and Public Affairs. “The Media and Chemical Risk: Toxicologists' Opinions on Chemical Risk and Media Coverage.” Media Monitor, Volume XXIII, Number 2, Summer 2009. Page 4 (the full chart of organisations toxicologists believe overstate chemical risk, and the footnote recording that “don't know” responses were excluded and that the full report gives both calculations); page 5 (media accuracy, “dose makes the poison” — 96% poor against 3% well); page 6 (survey methodology). Read 2026-08-06. cmpa.gmu.edu · Media Monitor XXIII(2), Summer 2009 ↩
- Lichter SR. “Are chemicals killing us?” Statistical Assessment Service (STATS) and the Center for Health and Risk Communication, George Mason University, 21 May 2009 — the sampling frame of 3,562 SOT full members, 1,136 respondents, 32% return rate, the 937 who answered every question, and the exclusion of “not sure” responses from Table 3 “to insure that the comparisons are commensurable”. STATS no longer operates; read in the Internet Archive capture of 2 January 2011. web.archive.org/web/20110102211813 ↩
- Commission Regulation (EU) No 1003/2014 of 18 September 2014 amending Annex V to Regulation (EC) No 1223/2009 — entry 39, Methylchloroisothiazolinone (and) Methylisothiazolinone, rinse-off products, 0,0015 % of a mixture in the ratio 3:1 of 5-chloro-2-methylisothiazol-3(2H)-one and 2-methylisothiazol-3(2H)-one. OJ L 282, 26.9.2014, pp. 1–4. Cited to keep entry 39 and entry 57 apart: the two carry the same figure, are mutually exclusive under the footnote to entry 57, and are not the same restriction. CELEX 32014R1003 ↩
- Regulation (EC) No 1223/2009 of the European Parliament and of the Council of 30 November 2009 on cosmetic products, Annex V, entries 39 and 57 and their footnotes. Consolidated text of 1 May 2026, CELEX 02009R1223-20260501 (version 040.001), read 2026-08-06 — entry 57 still reads Rinse-off products, 0,0015 %, marked as amended by Regulation (EU) 2017/1224. CELEX 02009R1223-20260501 ↩
- Toxicologists' Opinions on Chemical Risk: A Survey of the Society of Toxicology, 21 May 2009 — the full report behind the Media Monitor summary. Title page: “Conducted by Statistical Assessment Service (STATS) and Center for Health and Risk Communication at George Mason University. Administered by Harris Interactive.” No individual author is named on the report. The chart on report page 20 excludes “not sure” responses; the chart on page 21 includes them and is the source of the Greenpeace 83%, Environmental Defense Fund 61%, Environmental Working Group 40% and EPA 39% figures. Retrieved from the Internet Archive capture of 2 January 2011 of stats.org, which the 2009 article linked as “Download a PDF of the full report”. web.archive.org · Toxicology Survey.pdf ↩
Corrections to this article
None yet. Errors of fact are fixed in public and logged with the date, what we said and what it says now. The corrections log · Report an error.