Skip to content

Commit

Permalink
Move imports back to single cell
Browse files Browse the repository at this point in the history
  • Loading branch information
tylere committed May 24, 2024
1 parent b807563 commit 3a1c2b8
Show file tree
Hide file tree
Showing 22 changed files with 7,103 additions and 68 deletions.
45 changes: 5 additions & 40 deletions 00_core.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -35,49 +35,14 @@
"outputs": [],
"source": [
"#| export\n",
"import logging"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"#| export\n",
"import ee"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"#| export\n",
"import dask.distributed"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"#| export\n",
"import logging\n",
"\n",
"import coiled\n",
"import dask.distributed\n",
"import ee\n",
"import google.auth"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"#| export\n",
"import coiled"
]
},
{
"cell_type": "code",
"execution_count": null,
Expand Down
21 changes: 12 additions & 9 deletions _docs/00_core.html → _docs/core.html
Original file line number Diff line number Diff line change
Expand Up @@ -109,10 +109,10 @@

<link rel="stylesheet" href="styles.css">
<meta property="og:title" content="earthengine-dask - core">
<meta property="og:description" content="Scale up concurrent requests to Earth Engine interactive endpoints with Dask">
<meta property="og:description" content="Core functionality for distributing Earth Engine requests among Dask workers.">
<meta property="og:site_name" content="earthengine-dask">
<meta name="twitter:title" content="earthengine-dask - core">
<meta name="twitter:description" content="Scale up concurrent requests to Earth Engine interactive endpoints with Dask">
<meta name="twitter:description" content="Core functionality for distributing Earth Engine requests among Dask workers.">
<meta name="twitter:card" content="summary">
</head>

Expand Down Expand Up @@ -149,7 +149,7 @@
<button type="button" class="quarto-btn-toggle btn" data-bs-toggle="collapse" data-bs-target=".quarto-sidebar-collapse-item" aria-controls="quarto-sidebar" aria-expanded="false" aria-label="Toggle sidebar navigation" onclick="if (window.quartoToggleHeadroom) { window.quartoToggleHeadroom(); }">
<i class="bi bi-layout-text-sidebar-reverse"></i>
</button>
<nav class="quarto-page-breadcrumbs" aria-label="breadcrumb"><ol class="breadcrumb"><li class="breadcrumb-item"><a href="./00_core.html">core</a></li></ol></nav>
<nav class="quarto-page-breadcrumbs" aria-label="breadcrumb"><ol class="breadcrumb"><li class="breadcrumb-item"><a href="./core.html">core</a></li></ol></nav>
<a class="flex-grow-1" role="button" data-bs-toggle="collapse" data-bs-target=".quarto-sidebar-collapse-item" aria-controls="quarto-sidebar" aria-expanded="false" aria-label="Toggle sidebar navigation" onclick="if (window.quartoToggleHeadroom) { window.quartoToggleHeadroom(); }">
</a>
</div>
Expand All @@ -169,7 +169,7 @@
</li>
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="./00_core.html" class="sidebar-item-text sidebar-link active">
<a href="./core.html" class="sidebar-item-text sidebar-link active">
<span class="menu-text">core</span></a>
</div>
</li>
Expand Down Expand Up @@ -224,22 +224,22 @@ <h1 class="title">core</h1>

<!-- WARNING: THIS FILE WAS AUTOGENERATED! DO NOT EDIT! -->
<hr>
<p><a href="https://github.com/VorGeo/earthengine-dask/blob/master/earthengine_dask/core.py#L33" target="_blank" style="float:right; font-size:smaller">source</a></p>
<p><a href="https://github.com/VorGeo/earthengine-dask/blob/master/earthengine_dask/core.py#L26" target="_blank" style="float:right; font-size:smaller">source</a></p>
<section id="clustergee" class="level3">
<h3 class="anchored" data-anchor-id="clustergee">ClusterGEE</h3>
<blockquote class="blockquote">
<pre><code> ClusterGEE (**kwargs)</code></pre>
</blockquote>
<p>Create a Dask cluster with Coiled</p>
<p><em>Create a Dask cluster with Coiled</em></p>
<hr>
<p><a href="https://github.com/VorGeo/earthengine-dask/blob/master/earthengine_dask/core.py#L22" target="_blank" style="float:right; font-size:smaller">source</a></p>
<p><a href="https://github.com/VorGeo/earthengine-dask/blob/master/earthengine_dask/core.py#L15" target="_blank" style="float:right; font-size:smaller">source</a></p>
</section>
<section id="initearthengine" class="level3">
<h3 class="anchored" data-anchor-id="initearthengine">InitEarthEngine</h3>
<blockquote class="blockquote">
<pre><code> InitEarthEngine (**kwargs)</code></pre>
</blockquote>
<p>Interface to extend the Worker</p>
<p>*Interface to extend the Worker</p>
<p>A worker plugin enables custom code to run at different stages of the Workers’ lifecycle.</p>
<p>A plugin enables custom code to run at each of step of a Workers’s life. Whenever such an event happens, the corresponding method on this class will be called. Note that the user code always runs within the Worker’s main thread.</p>
<p>To implement a plugin:</p>
Expand All @@ -248,7 +248,7 @@ <h3 class="anchored" data-anchor-id="initearthengine">InitEarthEngine</h3>
<li>override some of its methods</li>
<li>register the plugin using :meth:<code>Client.register_plugin&lt;distributed.Client.register_plugin&gt;</code>.</li>
</ol>
<p>The <code>idempotent</code> attribute is used to control whether or not the plugin should be ignored upon registration if a worker plugin with the same name already exists. If <code>True</code>, the plugin is ignored, otherwise the existing plugin is replaced. Defaults to <code>False</code>.</p>
<p>The <code>idempotent</code> attribute is used to control whether or not the plugin should be ignored upon registration if a worker plugin with the same name already exists. If <code>True</code>, the plugin is ignored, otherwise the existing plugin is replaced. Defaults to <code>False</code>.*</p>
</section>
<section id="try-it-out" class="level1">
<h1>Try it out</h1>
Expand Down Expand Up @@ -516,6 +516,9 @@ <h1>Shut down the cluster.</h1>
</section>

<!-- /main -->
<script type="application/vnd.jupyter.widget-state+json">
{"state":{},"version_major":2,"version_minor":0}
</script>
<script id="quarto-html-after-body" type="application/javascript">
window.document.addEventListener("DOMContentLoaded", function (event) {
const toggleBodyColorMode = (bsSheetEl) => {
Expand Down
4 changes: 3 additions & 1 deletion _docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -105,8 +105,10 @@

<link rel="stylesheet" href="styles.css">
<meta property="og:title" content="earthengine-dask">
<meta property="og:description" content="Scale up concurrent requests to Earth Engine interactive endpoints with Dask">
<meta property="og:site_name" content="earthengine-dask">
<meta name="twitter:title" content="earthengine-dask">
<meta name="twitter:description" content="Scale up concurrent requests to Earth Engine interactive endpoints with Dask">
<meta name="twitter:card" content="summary">
</head>

Expand Down Expand Up @@ -163,7 +165,7 @@
</li>
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="./00_core.html" class="sidebar-item-text sidebar-link">
<a href="./core.html" class="sidebar-item-text sidebar-link">
<span class="menu-text">core</span></a>
</div>
</li>
Expand Down
8 changes: 4 additions & 4 deletions _docs/search.json
Original file line number Diff line number Diff line change
Expand Up @@ -60,8 +60,8 @@
]
},
{
"objectID": "00_core.html",
"href": "00_core.html",
"objectID": "core.html",
"href": "core.html",
"title": "core",
"section": "",
"text": "source",
Expand All @@ -70,8 +70,8 @@
]
},
{
"objectID": "00_core.html#authenticate-initialize-earth-engine",
"href": "00_core.html#authenticate-initialize-earth-engine",
"objectID": "core.html#authenticate-initialize-earth-engine",
"href": "core.html#authenticate-initialize-earth-engine",
"title": "core",
"section": "Authenticate & Initialize Earth Engine",
"text": "Authenticate & Initialize Earth Engine\nGet credentials and the GCP project ID, authenticating if necessary.\n\ntry:\n credentials, project_id = google.auth.default()\nexcept google.auth.exceptions.DefaultCredentialsError:\n !gcloud auth application-default login\n credentials, project_id = google.auth.default()\n\nee.Initialize(credentials=credentials, project=project_id)",
Expand Down
6 changes: 3 additions & 3 deletions _docs/sitemap.xml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,10 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://VorGeo.github.io/earthengine-dask/index.html</loc>
<lastmod>2024-05-24T22:13:48.945Z</lastmod>
<lastmod>2024-05-24T23:27:31.612Z</lastmod>
</url>
<url>
<loc>https://VorGeo.github.io/earthengine-dask/00_core.html</loc>
<lastmod>2024-05-24T22:53:24.599Z</lastmod>
<loc>https://VorGeo.github.io/earthengine-dask/core.html</loc>
<lastmod>2024-05-24T23:27:32.312Z</lastmod>
</url>
</urlset>
1 change: 1 addition & 0 deletions _proc/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
/.quarto/
Loading

0 comments on commit 3a1c2b8

Please sign in to comment.