Final results
De-identify 139.7 GB of drawings, CAD files, and archives with consistent pseudonyms while keeping every file usable. 20 scored attempts.
Machina's engineering corpus has 188,722 files totaling 139.7 GB: PDFs, drawings, SolidWorks and Inventor files, neutral CAD formats, images, and archives. Build a pipeline that replaces identifying information with consistent pseudonyms while keeping every engineering file usable and the links between them intact.
You do not need an AWS account. Download the input with the get-input.sh script below, run your pipeline, upload your output to your team's Builders folder with upload.py, and submit that location on this page.
Download the corpus into ./input/ with get-input.sh. Use a case-sensitive filesystem with room for the 139.7 GB input, unpacked archives, and your output.
Process the full corpus with a reproducible pipeline on any machine. Keep temporary files and private mappings out of your submission folder.
Give each attempt its own attempt-N/ folder containing a full copy of your output and code:
Download upload.py below (Python 3, nothing to install), then press Get upload token in the submission panel. The token lasts 1 hour and writes only to your team's private Builders folder, gs://builders-machina-submissions-use1/teams/<your-team-id>/.
Run the upload.py command shown in the panel to upload corpus/, code/, and README.txt into attempt-N/. If the token expires mid-upload, get a new one and paste it when upload.py prompts; re-running upload.py skips files already uploaded.
Submit gs://builders-machina-submissions-use1/teams/<your-team-id>/attempt-N/ in the form on this page. You do not need to look up your team id: after Get upload token, the panel shows your folder with it filled in, and Use in submit box copies it into the form. Files in your Builders folder are deleted 10 days after upload. Leave submitted attempts unchanged until results are published.
Builders folders moved on Saturday night. Attempts you uploaded before the move are still in gs://builders-machina-submissions-1120/teams/<your-team-id>/: their scores stand and you can still submit them as they are, but nothing new can be written there. Reload this page before you press Get upload token, and upload new attempts to the folder the panel then shows.
Each attempt is scored out of 1,000 private checks on corpus/, with pass counts by category (never which checks or files). A check on a file the scorer cannot find or open fails (and shows as not checked), so a broken or missing file costs points. Keep each file's extension and the parts of its path that do not identify anyone so the scorer can find the files it checks.
Grading usually takes under 20 minutes once started, and at most 3 hours. Your team has 20 scored attempts in total and may submit once an hour.
Machina is hiring Engineering Researchers. Apply at https://www.machina.how/app/pages/custom_view_887nw8e216.
Machina will refer the top 3 teams for a first-round interview.
If your output is already in an AWS S3 bucket you own in us-west-2, you can submit from there instead. Apply the bucket policy in challenge.pdf once to allow public s3:GetObject on submissions/* and s3:ListBucket on submissions/ and submissions/*, with no public writes and input/ kept private. If your account blocks public buckets, ask an organizer; do not change account-wide controls or share AWS credentials.
Verify public access with aws s3 ls s3://<bucket>/submissions/attempt-1/ --recursive --no-sign-request --region us-west-2, and test downloading one file from corpus/ and one from code/. Submit s3://<bucket>/submissions/attempt-1/ (the folder holding corpus/, not corpus/ itself) on this page.
gs://builders-machina-submissions-use1/teams/your-team-id/attempt-1/
Each attempt's corpus/ is checked against 1,000 private checks: names replaced consistently everywhere they appear, and the engineering files still usable. You see your total score and pass counts by category, never which checks or files.
The leaderboard at the cutoff is final. Your best scored attempt keeps its score, and nothing new is graded at the cutoff.
The cutoff is .