Password required

This draft is private. Enter the password to continue.

Incorrect password.
Internal draft · not yet shared with CHIRP

Diamond

“By the end of this tranche, CHIRP must be able to access well-structured data from the 2 existing and up to 6 additional jurisdictions’ reports via an LLM (our own or a 3rd party) to compare incidents, identify recurring patterns and synthesise lessons with conclusions traceable to the underlying source reports.”

CHIRP’s requirements

  • Reports from the UK, the US and up to 6 more countries
  • CHIRP’s own reports
  • Asked through an AI, CHIRP’s own or a third party’s
  • Compare incidents, find recurring patterns and draw lessons
  • Every conclusion traceable to its source report
  • SHIELD matching
  • Kept up to date automatically
  • A validated test set
  • Logging
  • Stretch: open to people CHIRP shares the link with

£49,600 · 99.2 days at £500 a day. Hosting and AI usage paid by CHIRP.

What CHIRP gets

Outcome Build days Total days Cost
Asked through an AI Users ask in the Claude harness through a CHIRPdb connector. Only people CHIRP gives access to can use it. 10 17 £8,500
Compare incidents, find recurring patterns and draw lessons Counts across every report, not just the top matches, and finds similar past incidents, so the AI can compare them and draw lessons. 6.5 11.05 £5,525
Every conclusion traceable to its source report Each conclusion links to the right page of the source PDF. 1.5 2.55 £1,275
Reports from the UK, the US and up to 6 more countries The 6 more countries are chosen by CHIRP, added to the UK and US reports already in from Tranche 1. 15 21 £10,500
Compare incidents across countries like with like One shared vocabulary for vessel type, accident type, outcome and so on, so that a count in one country means the same as a count in another. 12 20.4 £10,200
SHIELD matching SHIELD codes proposed for every report and confirmed by CHIRP in the review tool, so incidents can be counted by causal factor. 6 10.2 £5,100
CHIRP’s own reports CHIRP Maritime’s published reports, searchable alongside the investigation reports. 3 5.1 £2,550
Kept up to date automatically New reports are ingested automatically as each source publishes them. 2 3.4 £1,700
A validated test set, and logging A validated test set, re-run after every change to prove the answers are right, and a log of every question asked. 5 8.5 £4,250
Total 61 99.2 £49,600

Stretch goal

Stretch goal Build days Total days Cost

Taken on if time allows, or funded on top, which brings Diamond to £53,425.

Where the days go

Work Days Cost
Build61£30,500
Contingency12.2£6,100
Project management (not on the 6 new countries)13.8£6,900
ZigZag product management, including a Maritime Safety Senior Stakeholder Workshop to decide the future direction of CHIRPdb12.2£6,100
Total99.2£49,600

Not included

Hosting and AI usage are paid by CHIRP. Costs come from the full menu.

Glossary

Questions Diamond can answer

Illustrative: the tool names and fields are settled during the build, and the figures and vessel names in the answers are made up for illustration.

How CHIRP’s users get answers

SET UP ONCE EVERY TIME Ask a follow-up CHIRP invites them in the CHIRPdb frontend They add the connector to the Claude harness They sign in once with a CHIRPdb account They ask Claude a question in plain English They get an answer compared across 8 countries They check the source every claim links to the PDF

What happens when someone asks a question

USER CLAUDE HARNESS CHIRPDB CONNECTOR CHIRPDB API 1 Asks a question in plain English 2 Reads the instructions and picks which tools to use 3 Passes the request on with the user’s sign-in 4 Checks access, logs it, then: · counts the matching reports by SHIELD code, vessel type, country, date or outcome · finds the matching reports · pulls passages and PDF pages 5 Returns the results counts and passages, with links 6 Writes the answer compares, draws lessons, cites 7 Checks a source one click to the PDF page

How it fits together

SOURCES UK and US from Tranche 1 6 more countries investigation bodies CHIRP reports CHIRP Maritime’s own Automatic ingestion CHIRPdb Database Verified reports Shared vocabulary, extended SHIELD matching on every report API Search Sign-in, roles and scope Count across every report Find similar incidents Logging of every question Frontend Review tool: confirm SHIELD codes Manage users and access CHIRPdb connector turns the AI’s requests into API calls rate limits: stretch Claude harness Users invited by CHIRP Validated test set known questions, asked end to end CHIRP manages access Tranche 1 Tranche 2

Scope status after CHIRP’s update

Deliverable Done when In Diamond
Must
A broad and validated data set “The real Must is a broad and validated data-set.” (CHIRP’s update) In Reports from the UK, the US and up to 6 more countries, Compare incidents across countries like with like, SHIELD matching, A validated test set, and logging. The 6 new countries use fast ingestion; the validated test set checks the answers drawn from them.
3a Pattern analysis “As a CHIRP analyst, I want to ask questions across all reports and datasets, so that I can unearth patterns and publish insight that raises awareness and encourages improvement.” CHIRP’s top priority. “An analyst query returns pathways with supporting cases, and drafting support produces a reviewable outline.” In Compare incidents, find recurring patterns and draw lessons, Every conclusion traceable to its source report. Claude shows the recurring sequences with their supporting cases, and drafts an outline from the cited results for an analyst to review.
1a Task briefing “As a seafarer or supervisor about to start a task, I want to know what has gone wrong during similar work, so that I recognise the critical hazards before I start.” “A member of the public asks a task question and receives a briefing in which every claim is cited to a verified report.” In Asked through an AI, Compare incidents, find recurring patterns and draw lessons, Every conclusion traceable to its source report. For invited users; opening it to the public is the stretch goal.
2a Near miss “As a seafarer who has just had a near miss, I want to describe what happened, so that I can see whether others have experienced the same thing and what they learned.” “A typed description returns related verified incidents, their shared factors and a link to CHIRP’s reporting form.” In Compare incidents, find recurring patterns and draw lessons (find similar incidents). The AI is instructed to point near misses to CHIRP’s reporting form.
All marine accident investigation bodies publishing in English “Full investigation reports from flag and coastal states. The core corpus. MAIB reports are already ingested (P1).” In Reports from the UK, the US and up to 6 more countries, the breadth CHIRP set for Tranche 2.
Should
CHIRP Maritime published reports “De-identified confidential reports and commentary. Closest to seafarer experience. Roadmap step 13.” In CHIRP’s own reports.
Citation integrity “Every public answer cites verified records and links to the source report (step 10).” In Every conclusion traceable to its source report. Still a fixed constraint in the scope.
1b Toolbox talk “As an onboard supervisor, I want the briefing produced as a toolbox talk, so that I can brief the crew from real incidents.” “A request for a named task returns a printable toolbox talk with sources.” In Asked through an AI, see the example questions.
2b Code incoming reports “As a CHIRP analyst, I want each report we receive coded and set against similar cases, so that I can assess it quickly and consistently and respond with context.” “A submitted report returns proposed coding and similar cases, and nothing enters the database until verified in the review tool.” Partly SHIELD matching and Compare incidents, find recurring patterns and draw lessons (find similar incidents), for published reports only.
Production hardening “Logins and role-based access for CHIRP staff and partners; anonymous public access kept separate from the review tool and drafting features.” Partly sign-in and user management in Asked through an AI.
Public usage controls “Rate limiting per user, a spending cap on question-answering costs, and protection against abuse, scraping and prompt injection.” Partly rate limits and abuse protection in the stretch goal.
Monitoring and correction “Usage and error monitoring with alerts, and a route to correct or withdraw a published answer or record.” Partly monitoring in Asked through an AI. No correction route.
MAIB Safety Digests and bulletins “Short-form learning. Roadmap step 13.” Future scope
Duplicate and derivative tracking “Many sources republish or edit the same event (MARS, SAFETY4SEA, IMO GISIS and national bodies). Each derivative account links to its source report, and pattern analysis counts the event once.” Future scope
3b Dashboards “As a shore-side manager or commercial operator, I want to explore trends across the evidence base, so that I can find vulnerabilities and decide where to invest.” “Dashboards filter by vessel type, date, outcome and country, and every figure traces to verified records.” Future scope The same counts can be asked for through Asked through an AI.
3c Legislation links “As CHIRP, I want to see where incidents recur because regulation is absent, unclear or poorly implemented, so that I can put evidence to flag states and encourage change.” “Findings carry AI-proposed legislation links, clearly caveated for the user to verify, and an analyst can list recurring findings by instrument.” Future scope
IMO GISIS Marine Casualties and Incidents module “Investigation reports submitted to IMO, filling gaps for states without their own publication site.” Future scope
IMO Lessons Learned from casualty investigations “Short anonymised lessons drawn from member-state investigations.” Future scope
Nautical Institute MARS “Free-text narratives of the kind third parties will submit. Mostly edited from regulators’ reports, so depends on duplicate tracking.” Future scope
SAFETY4SEA “Incident news and safety articles, often derived from investigation reports, so depends on duplicate tracking.” Future scope
IMCA safety flashes “Offshore and marine contracting incidents with lessons.” Future scope
USCG Marine Safety Alerts and lessons learned “Short-form alerts linked to US investigations.” Future scope
UK legislation and MCA notices “Instruments to link findings against, starting with the UK flag.” Future scope
ILO Maritime Labour Convention “Hours of rest, manning and welfare requirements.” Future scope
IMO conventions and codes “The core international instruments.” Future scope
Could
1c Upload a risk assessment, permit or plan “As an onboard supervisor, I want to upload a draft risk assessment, permit or plan, so that it is challenged against previous incidents before authorisation.” “An uploaded document returns missing hazards and controls with sources, and is deleted after the session.” Future scope
2c Upload your own report “As an organisation or onboard investigator, I want to upload our own report or event narrative, so that I can find comparable cases and lines of enquiry, knowing the document itself is not kept.” “An upload returns comparable cases and factors. At session end the document is deleted and a pattern record (SHIELD codes, vessel type, operation, outcome, no narrative) is stored, flagged as contributor-derived and used in aggregate analysis only.” Future scope
Upload terms “Terms stating where uploaded files are processed, that documents are deleted after the session, and that a de-identified pattern record is kept from 2c uploads.” Future scope
Scanned pre-2005 reports “Historic depth. Requires OCR, excluded from P1.” Future scope
P&I club loss prevention publications “Claims-led trend analysis and case studies.” Future scope
Copernicus metocean data “Historical wind, wave and sea state at the time and position of each incident, enriching reports that omit or understate conditions. Needs incident position and time from extraction (step 6).” Future scope

Every deliverable in the Tranche 2 Development Scope, with its description quoted from that document, grouped by its priority after CHIRP moved 2b and all Musts except 1a, 2a and 3a to Should. Won’t items are left out.