Blog

Lab-to-AI: From Raw Zone to SageMaker and HealthOmics

The science team’s request arrived as four words: “AI on our data.” Behind it stood a platform team with a validated raw zone, a governance model built for audits, and no plan for what happens when a model wants to read everything.

Read More

Observability as Audit Evidence

Mid-investigation, someone asked for the transfer logs from eleven weeks ago—the ones that would show exactly what happened to run R. The retention policy was thirty days. The logs that could have answered the question had been rotated into nothing, and the finding closed as “probable, not demonstrable.”

Read More

Validated Delivery: CI/CD Under GxP Change Control

The validation auditor asked for the change record behind a production change made two weeks earlier. The honest answer was a Slack thread, a terraform apply from someone’s laptop, and a Jira ticket with no attachments. None of that is a change record.

Read More

Should Your Raw Instrument Zone Become Iceberg?

The science team asked a reasonable question: “Can we query two years of run metadata without a week of Athena scans?” The raw prefix held forty million objects, LIST calls were timing out, and every dashboard paged through keys like it was 2013.

Read More

Instrument Ingestion Patterns: Poller, DataSync, or S3 Events

Three instruments, three capabilities. One writes finished runs to a Windows share. One can call the S3 API directly. One ships files over SFTP to wherever you point it. The team forced all three through one custom poller—and spent a year paying for it in special cases.

Read More

The ALCOA+ Field Guide for Platform Engineers

The auditor asked a simple question: “How do you know this file was not modified after upload?” The team had versioning off, a shared transfer credential, and a fourteen-second silence that felt much longer.

Read More
Categories
Tags