Files

As with all systems, precisionFDA relies on files to store data. Files can be uploaded from your computer or generated by running apps, and can be shared with the precisionFDA community.

Listing files

Clicking on "Files" at the top navigation bar takes you to the a page that lists all the files accessible by your account. Files owned by you are shown under "My Files." Public precisionFDA members' contributions (including yours) are shown under "Explore". You can further filter files by clicking on the "eye" icon, which will reveal a filter bar. For example, you can search on filename by entering a keyword in the "Name" field. Choose any filters and apply them by clicking on the "funnel" icon.

The precisionFDA system also allows users to organize files into folders, putting similar files together. Click "Add folder" to create a new sub-folder in the current folder. This will prompt the you for the name of the new folder. Files can be moved into a folder by selecting them, clicking the "gear" button (top right), selecting "Move," and choosing the destination folder.

Each file and folder has a checkbox on the left; checking it will select that file/folder. If an individual file is selected, you can rename the file. You can multiselect files/folders to perform an operation on all of them. With one or more file or folder selected, you can move the selected objects into another folder or publish the selected files and any files inside the folders you have selected. A dialog will pop up to confirm the files you have selected. You can also choose to delete these files, which will similarly show a confirmation dialog. Finally, you can choose to download these files, which will show a dialog allowing you to download each individual file. Due to the size of files, generating a tarball is not possible at this time.

Uploading files

You can upload small files directly from your web browser by clicking "Add files". Choose the files you want to upload, and click "Upload all" to begin the upload to cloud storage. To ensure integrity, your web browser will automatically calculate a checksum of the uploaded content and ensure that it matches the checksum calculated on the cloud side.

Once the upload is complete, the system will perform some additional finalization. This process usually takes a few seconds, during which the file is in a "closing" state. After finalization is completed, the file becomes "closed" and can now be used within precisionFDA (downloaded, published, or provided as input in apps). Its contents can never be changed, and it is given a unique, immutable id of the form "file-Bk0kjkQ0ZP01x1KJqQyqJ7yq" to distinguish it across the whole site.

If the upload gets interrupted for any reason, you will see the partially-uploaded file in your list of files, marked with an "open" state. Please delete the file and reupload it. Periodically, the precisionFDA system may automatically clean up partially uploaded files.

TIP: Web browsers have limitations with regards to their upload capabilities. Therefore, you should only use the browser-based method for small files. Read below for additional options if you have large data to upload.

For large files that are accessible over the Internet, we suggest running the "Fetch file from URL" app, which has been provided by the precisionFDA team. The app allows you to fetch a file from a given URL.

For large files that are on your computer, we suggest using the precisionFDA uploader, a command-line tool capable of uploading with multiple threads and more resilient to transient errors. The precisionFDA uploader can be used for both files and app assets, and it's available through the Create Assets page.

Visit that page and download the precisionFDA uploader for your operating system and architecture by clicking the respective button under "Step 3".

The tool requires an "authorization key" in order to authenticate the client against the precisionFDA system. You can get a key by clicking the respective button under "Step 4" in the "Add Assets" page. Copy the key from that page and paste it in the command below where it says KEY. For your security, the key is valid for 24h.

Run ./pfda --cmd upload-file --key KEY --file /path/to/file. This command will upload the file to precisionFDA.

TIP: The uploader saves your key in $HOME/.config/precision-fda/config.json, so after you have run it once, you don't need to specify the key in subsequent invocations.
Examining file origin

The system automatically records the origin of files. The "origin" column describes how each file got introduced to precisionFDA; it is set to "Uploaded" if the file was directly uploaded; otherwise it points to a job if the file was generated by running an app. Further information can be obtained using the tracking feature.

File details

Clicking on a filename in the files list (or on other file links that appear in certain precisionFDA areas) takes you to the file details page, which shows information such as filename, unique id, size, creation time, and origin. In addition, if the file has been used as input to any comparisons or has been attached to any notes, those will also be visible in respective sub-sections.

This page shows one or more action buttons, depending on the file state and your permissions:

Click... In order to...
Attach to... Attach the file to a note. See the notes section for more info.
Open Open the file inline in your browser (if your browser supports it). Use this action to see the content of text files, PDF files, images, etc.
Download Download the file right away via your browser.
Authorized URL Generate an authorized URL via which the file can be downloaded non-interactively.
Track Display a graph tracking the file's provenance. See Tracking for more info.
Publish Publicly contribute the file to the precisionFDA community. See Publishing for more info.
Delete Permanently remove the file from precisionFDA.