Integrating Valyu Datasets
Last updated
Last updated
The following short video demo shows how to integrate proprietary datasets listed on the Valyu Exchange into your ML workflows seamlessly
Spoiler Alert 🚨 - it is super simple...
Check out the notebook for yourself here!
The Valyu SDK allows you to seamlessly integrate proprietary data sources into your existing AI/ML workflows. To make the process even more user-friendly, we have modelled our dataset loader after the Hugging Face SDK, so you can use the methods you already know and love.
Here's how to get started:
Generate an API Key: Once granted access to a dataset, navigate to My Hub and generate an API key. Be sure to store it securely, as it will not be visible again.
Fetch the Dataset Identifier: Go to the dataset and obtain the dataset identifier from the URL. (It is of the form {organisation_id}/{dataset_name})
Load the Dataset: Use your API key and dataset identifier with the load_dataset method to retrieve the dataset.
Our SDK places a strong emphasis on type annotation, to ensure the best possible developer experience for our users.
If you have any feedback please reach out to us at contact@valyu.network, or on X..We'd love to hear from you!