Upload Pi agent session traces to Hugging Face dataset
Session from pi-sessions on Hugging Face by julien-c · CC-BY-4.0 · condensed by Coders Talk
Click a segment to jump to that moment
8msession
0interventions
GOAL
Find local Pi agent session trace files and upload them to a Hugging Face Hub dataset, including an organized subfolder version.
- +0Prompt · +0Can you find the Pi sessions traces from this directory (~/.pi/agent/sessions) and tell me how many there are?
- +0mAgent did · +0mListed ~/.pi/agent/sessions and found 3 project directories, one being the huggingface.js sessions folder.
- +0mPrompt · +0mYes, look at the huggingface.js ones.
- +0mAgent did · +0mListed the huggingface.js session folder, finding 7 trace files ranging from 5KB to 362KB, all from the same day.
- +1mPrompt · +1mNo. Upload all of them to my huggingface.co/datasets/julien-c/pi-sessions dataset using the hf CLI skill.
- +1mAgent did · +1mRead the hf-cli skill doc, then ran hf upload to push all 7 jsonl files to the julien-c/pi-sessions dataset, producing a commit URL.
- +7mPrompt · +7mCan you also upload them in a subfolder named huggingface.js?
- +8mAgent did · +8mStarted copying the 7 jsonl files into /tmp/pi-upload/huggingface.js in preparation for a second upload into a named subfolder.
- +8mOutcome · +8m7 session trace files uploaded to the julien-c/pi-sessions dataset via a single hf upload commit.
VERDICT
I'd next time just ask upfront to upload straight into a named subfolder instead of doing the flat upload first and then redoing it. The hf-cli skill made the actual upload trivial once I pointed it at the right folder and dataset.