Integrating Valyu Datasets
Last updated
Was this helpful?
Last updated
Was this helpful?
The following short video demo shows how to integrate proprietary datasets listed on the Valyu Exchange into your ML workflows seamlessly
Spoiler Alert 🚨 - it is super simple...
Check out the notebook for yourself here!
The Valyu SDK allows you to seamlessly integrate proprietary data sources into your existing AI/ML workflows. To make the process even more user-friendly, we have modelled our dataset loader after the Hugging Face SDK, so you can use the methods you already know and love.
Here's how to get started:
Generate an API Key: Once granted access to a dataset, navigate to My Hub and generate an API key. Be sure to store it securely, as it will not be visible again.
Fetch the Dataset Identifier: Go to the dataset and obtain the dataset identifier from the URL. (It is of the form {organisation_id}/{dataset_name})
Load the Dataset: Use your API key and dataset identifier with the load_dataset method to retrieve the dataset.
Our SDK places a strong emphasis on type annotation, to ensure the best possible developer experience for our users.
If you have any feedback please reach out to us at contact@valyu.network, or on X..We'd love to hear from you!