-
Notifications
You must be signed in to change notification settings - Fork 3
links pyspark
Fabricio C Zuardi edited this page Jul 15, 2024
·
3 revisions
- https://medium.com/gigahex/read-and-write-to-s3-with-spark-f4d11de9a8f4
- https://github.com/spark-examples/spark-amazon-s3-examples/blob/master/src/main/scala/com/sparkbyexamples/spark/ParquetAWSExample.scala
- https://gist.github.com/borislitvak/4c4fc72ed65f58042b84e2f36e3d720e
- https://rebirth.devoteam.com/2023/05/02/data-files-from-s3-in-local-pyspark-environment/
- https://spark.apache.org/docs/latest/running-on-kubernetes.html
- https://www.notion.so/blog/building-and-scaling-notions-data-lake
- https://blog.min.io/databases-for-object-storage/
- https://spark.apache.org/docs/latest/quick-start.html
- https://www.ilkkapeltola.fi/2021/04/how-to-access-aws-s3-with-pyspark-locally-using-aws-profiles-tutorial.html