Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download job manager #37

Open
jeandet opened this issue Mar 16, 2022 · 0 comments
Open

Download job manager #37

jeandet opened this issue Mar 16, 2022 · 0 comments
Labels
enhancement New feature or request Low priority

Comments

@jeandet
Copy link
Member

jeandet commented Mar 16, 2022

While working on Catalog to DataFrame conv, I was thinking that maybe we could add a new module to easy scheduling data download.
For example when an user want to retrieve a list of products data for each event in a Catalog, he has to do something like:

data = { product:[spz.get_data(product,*event) for event in catalog] for product in product_list}

Which is OK for the simplicity but lacks some control over parallelism.

We could provide something like:

data = speasy.jobs.get_data( product_list, catalogs, max_concurrent_jobs)
@jeandet jeandet added the enhancement New feature or request label Mar 16, 2022
@jeandet jeandet added this to the 1.1 milestone Mar 16, 2022
@jeandet jeandet removed this from the v1.1.0 milestone Dec 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Low priority
Projects
None yet
Development

No branches or pull requests

1 participant