Skip to content

Commit

Permalink
Flesh out solutions sections
Browse files Browse the repository at this point in the history
  • Loading branch information
karenzone committed Oct 29, 2024
1 parent c5832a9 commit 066b327
Show file tree
Hide file tree
Showing 3 changed files with 97 additions and 37 deletions.
18 changes: 12 additions & 6 deletions docs/en/ingest-guide/ingest-intro.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,16 @@ language clients].
* To sync **data from third-party sources**, use link:{ref}/es-connectors.html[connectors].
* To index **single files** for testing, use the {kib} link:{kibana-ref}/connect-to-elasticsearch.html#upload-data-kibana[file uploader].
If you would like to test things out before you add your own data, try using our {kibana-ref}/connect-to-elasticsearch.html#_add_sample_data[sample data].
**Timestamped data**. Start with {fleet-guide}[Elastic Agent] and one of the hundreds of {integrations-docs}[Elastic integrations] that are available.
Integrations are available for many popular platforms and services, and are a good place to start.
Check out the {integrations-docs}/all_integrations[Integration quick reference] to search for available integrations.
If you don't find an integration for your data source, or if you need <<ingest-addl-proc,additional processing>>, we still have you covered.
If you would like to try things out before you add your own data, try using our {kibana-ref}/connect-to-elasticsearch.html#_add_sample_data[sample data].
**Timestamped data**. Start with {fleet-guide}[Elastic Agent] and one of the
hundreds of {integrations-docs}[Elastic integrations] that are available.
Integrations are available for many popular platforms and services, and are a
good place to start for ingesting data into Elastic solutions--Observability,
Security, and Search--or your own search application.
Check out the {integrations-docs}/all_integrations[Integration quick reference]
to search for available integrations.
If you don't find an integration for your data source or if you need
<<ingest-addl-proc,additional processing>> to extend the integration, we still have you covered.
****
110 changes: 82 additions & 28 deletions docs/en/ingest-guide/ingest-solutions.asciidoc
Original file line number Diff line number Diff line change
@@ -1,52 +1,106 @@
[[ingest-for-solutions]]
== Ingesting data for Elastic solutions

.WORK IN PROGRESS
****
For MVP: Add descriptions and links to existing solutions content with focus on tutorials where appropriate.
Elastic solutions--Security, Observability, and Search--are loaded with features
and functionality to help you get value and insights from your data.
{fleet-guide}[Elastic Agent] and {integrations-docs}[Elastic integrations] can help.

When you use integrations with solutions, you have an integrated experience that offers
easier implementation and decreases the time it takes to get insights and value from your data.

[ingest-process-overview]
.High-level overview
****
To use {fleet-guide}[Elastic Agent] and {integrations-docs}[Elastic integrations]
with Elastic solutions:
1. Create an link:https://www.elastic.co/cloud[{ecloud}] deployment for your solution.
If you don't have a {ecloud} account, you can sign up for a link:https://cloud.elastic.co/registration[free trial] get started.
2. Add the {integrations-docs}[Elastic integration] for your data source to the deployment.
3. link:{fleet-guide}/elastic-agent-installation.html[Install {agent}] on the systems whose data you want to collect.
****

NOTE: {serverless-docs}[Elastic serverless] makes using solutions even easier.
Sign up for a link:{serverless-docs}/general/sign-up-trial[free trial], and check it out.



[discrete]
[[ingest-for-search]]
=== Ingesting data for Search

{es} is the magic behind Search and our other solutions.
The solution gives you more pre-built components to get you up and running quickly for common use cases.

**Resources**

* link:{fleet-guide}/elastic-agent-installation.html[Install {agent}]
* link:https://www.elastic.co/integrations/data-integrations?solution=search[Elastic Search for integrations]
* link:{ref}[{es} Guide]
** link:{ref}/docs.html[{es} document APIs]
** link:https://www.elastic.co/guide/en/elasticsearch/client/index.html[{es} language clients]
** link:https://www.elastic.co/web-crawler[Elastic web crawler]
** link:{ref}/es-connectors.html[Elastic connectors]


[discrete]
[[ingest-for-obs]]
=== Observability
Monitor and gain insights
=== Ingesting data for Observability

With link:https://www.elastic.co/observability[Elastic Observability], you can monitor and gain insights into logs, metrics, and application traces.

**Resources**

* Logs
* Metrics
* Application traces
* link:{fleet-guide}/elastic-agent-installation.html[Install {agent}]
* link:https://www.elastic.co/integrations/data-integrations?solution=observability[Elastic Observability integrations]

Add links to targeted ingest resources in Observability docs.
**Guides for popular Observability use case**

* Logs and metrics: Use system integration: https://www.elastic.co/guide/en/observability/current/logs-metrics-get-started.html#add-system-integration
* Traces and APM: https://www.elastic.co/guide/en/observability/current/logs-metrics-get-started.html#add-system-integration
* Is this integration listed in https://www.elastic.co/docs/current/integrations
* link:{estc-welcome}/getting-started-observability.html[Monitor applications and systems with Elastic Observability]
* link:https://www.elastic.co/guide/en/observability/current/logs-metrics-get-started.html[Get started with logs and metrics]
** link:https://www.elastic.co/guide/en/observability/current/logs-metrics-get-started.html#add-system-integration[Step 1: Add the {agent} System integration]
** link:https://www.elastic.co/guide/en/observability/current/logs-metrics-get-started.html#add-agent-to-fleet[Step 2: Install and run {agent}]

* link:{serverless-docs}/observability/what-is-observability-serverless[Observability] on link:{serverless-docs}[{serverless-full}]:
** link:{serverless-docs}/observability/quickstarts/monitor-hosts-with-elastic-agent[Monitor hosts with {agent} ({serverless-short})]
** link:{serverless-docs}/observability/quickstarts/k8s-logs-metrics[Monitor your K8s cluster with {agent} ({serverless-short})]


[discrete]
[[ingest-for-security]]
=== Security
Detect and respond to threats
=== Ingesting data for Security

* Logs
* Metrics
* SIEM
* Endpoint
* Files
You can detect and respond to threats when you use link:https://www.elastic.co/security[Elastic Security] to analyze and take action on your data.

**Resources**

* link:{fleet-guide}/elastic-agent-installation.html[Install {agent}]
* link:https://www.elastic.co/integrations/data-integrations?solution=search[Elastic Security integrations]
* link:{security-guide}/es-overview.html[Elastic Security documentation]

https://www.elastic.co/guide/en/security/current/ingest-data.html[Ingest data into Elastic Security]:
**Guides for popular Security use case**

* Elastic Agent + integrations (spotlight Defend integration)
* Beats
* Elastic Agent from Splunk
* Third-party collectors + ECS
* link:https://www.elastic.co/guide/en/starting-with-the-elasticsearch-platform-and-its-solutions/current/getting-started-siem-security.html[Use Elastic Security for SIEM]
* link:https://www.elastic.co/guide/en/starting-with-the-elasticsearch-platform-and-its-solutions/current/getting-started-endpoint-security.html[Protect hosts with endpoint threat intelligence from Elastic Security]


[discrete]
[[ingest-for-search]]
== Search
[[ingest-for-custom]]
=== Ingesting data for your own custom search solution

Elastic solutions can give you a head start for common use cases, but you are not limited.
You can still do your own thing with a custom solution designed by you.

Bring your ideas and use {es} and the {stack} to store, search, and visualize your data.

**Resources**

* link:{fleet-guide}/elastic-agent-installation.html[Install {agent}]
* link:{ref}[{es} Guide]
** link:{ref}/docs.html[{es} document APIs]
** link:https://www.elastic.co/guide/en/elasticsearch/client/index.html[{es} language clients]
** link:https://www.elastic.co/web-crawler[Elastic web crawler]
** link:{ref}/es-connectors.html[Elastic connectors]

* https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html[Adding data with APIs]
* https://www.elastic.co/guide/en/fleet/current/beats-agent-comparison.html#additional-capabilities-beats-and-agent[Elasticsearch ingest pipelines]
* link:{estc-welcome}/getting-started-general-purpose.html[Tutorial: Get started with vector search and generative AI]

6 changes: 3 additions & 3 deletions docs/en/ingest-guide/ingest-tools.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -20,12 +20,12 @@ Check out the {integrations-docs}/all_integrations[Integration quick reference]
{agent} is the best option for collecting timestamped data for most data sources and use cases.
If your data requires additional processing before going to {es}, you can use {agent} with link:{fleet-guide}/elastic-agent-processor-configuration.html[{agent} processors] or link:{logstash-ref}[{ls}]
+
Ready to try link:{fleet-guide}[Elastic Agent]? Check out the link:{fleet-guide}/elastic-agent-installation.html[installation instructions].
Ready to try link:{fleet-guide}[{agent}]? Check out the link:{fleet-guide}/elastic-agent-installation.html[installation instructions].
+
**Beats.** link:{beats-ref}/beats-reference.html}[Beats] are the original Elastic lightweight data shippers, and their capabilities live on in Elastic Agent.
**Beats.** link:{beats-ref}/beats-reference.html[Beats] are the original Elastic lightweight data shippers, and their capabilities live on in Elastic Agent.
When you use Elastic Agent, you're getting core Beats functionality and more added features.
Beats require that you install a separate Beat for each type of data you want to collect.
A single Elastic Agent installed on a host can collect multiple types of data.
A single Elastic Agent installed on a host can collect and transport multiple types of data.
+
**Best practice:** Use link:{fleet-guide}[Elastic Agent] whenever possible.
If your data source is not yet supported by Elastic Agent, use Beats.
Expand Down

0 comments on commit 066b327

Please sign in to comment.