<h2>Overview</h2>
<p>The Astro CLI is a command-line interface designed for data orchestration, allowing users to quickly get started with Apache Airflow and compatible with all Astronomer products. It offers key functionalities like initializing projects, building Docker images, managing Docker containers, deploying code, and managing workspaces.</p>
<h2>Features</h2>
<ul>
<li><strong>Login &#x26; Logout:</strong> Easily log in or out of the Astro CLI.</li>
<li><strong>Project Initialization:</strong> Initialize an Astro project in an empty local directory.</li>
<li><strong>Build &#x26; Run Project:</strong> Build your project into a Docker image and spin up local Docker containers for Airflow components.</li>
<li><strong>Pause &#x26; Restart Environment:</strong> Pause or restart all Docker containers running the local Airflow environment.</li>
<li><strong>Deploy Code:</strong> Deploy code to a Deployment on Astro.</li>
<li><strong>Manage Workspaces:</strong> Conveniently handle Astronomer Workspaces.</li>
<li><strong>Help &#x26; Version:</strong> Access help information and check the running version of the Astro CLI.</li>
</ul>
<h2>Summary</h2>
<p>The Astro CLI serves as a powerful tool for orchestrating data with Apache Airflow, offering a range of essential features like project initialization, Docker image management, code deployment, and workspace management. The installation process varies based on the operating system, requiring specific prerequisites to ensure seamless setup and usage of the Astro CLI.</p>


<h2>Overview</h2>
<p>The Astronomer Databricks Provider has made significant contributions to the Apache Airflow community, providing developers with powerful tools to streamline their workflow management. As a solution designed for those utilizing Databricks, this provider integrates seamlessly with Airflow, enabling users to create and manage Databricks workflows efficiently. Although Astronomer has transitioned these features to the Apache Airflow repository, the provider will continue to play a crucial role in data orchestration.</p>
<p>With the potential for a notable cost reduction in running Databricks notebooks—up to 75%—this integration makes it an appealing option for anyone looking to optimize their data processing tasks. Even though Astronomer has shifted its focus, the legacy of the Astronomer Databricks Provider is still relevant for users exploring efficient workflows with Airflow.</p>
<h2>Features</h2>
<ul>
<li>
<p><strong>Cost Efficiency</strong>: Leverage Databricks Workflows through Airflow to experience significant savings on compute costs.</p>
</li>
<li>
<p><strong>Easy Migration</strong>: Transitioning from the deprecated features to the official Apache Airflow Databricks Provider is straightforward, requiring only a change in the import path in your code.</p>
</li>
<li>
<p><strong>Community Support</strong>: As part of the open-source community, users can continue to contribute and enhance the functionality, ensuring its growth and longevity.</p>
</li>
<li>
<p><strong>Rich Authoring Interface</strong>: Define complex workflows with code in Airflow DAGs, providing a robust alternative to the web-based UI of Databricks.</p>
</li>
<li>
<p><strong>Open Accessibility</strong>: The provider is available to all Airflow users, removing barriers for those who do not hold an Astronomer customer status.</p>
</li>
<li>
<p><strong>Historical Significance</strong>: This repository serves as a historical record, allowing users to understand the evolution of Databricks integration within Airflow, even as it is no longer actively maintained.</p>
</li>
<li>
<p><strong>Automated Workflows</strong>: Create and manage automated workflows that utilize the full power of Airflow and Databricks in concert.</p>
</li>
</ul>
<p>This combination of features not only enhances productivity but also ensures that users have the tools they need to manage their data workflows effectively.</p>


<h2>Overview</h2>
<p>Combining the power of Apache Airflow with Ray's distributed computing capabilities creates a robust environment for orchestrating Ray jobs. This integration allows data engineers and scientists to streamline workflows, enabling more efficient and scalable processes for tasks ranging from ETL to fine-tuning large language models. With a quick setup and rich features, you can manage complex workflows while leveraging the strengths of both platforms.</p>
<p>The ability to monitor job progress and manage dependencies provides a seamless experience that enhances productivity. This synergy between Airflow and Ray is particularly beneficial for users looking to execute complex workflows with ease and efficiency.</p>
<h2>Features</h2>
<ul>
<li><strong>Integration</strong>: Easily incorporate Ray jobs into Airflow DAGs, allowing for a unified approach to workflow management.</li>
<li><strong>Distributed Computing</strong>: Leverage Ray's powerful distributed capabilities within Airflow pipelines for scalable computing tasks, including ETL processes.</li>
<li><strong>Monitoring</strong>: Gain insights into Ray job progress using Airflow's intuitive user interface, ensuring you stay informed about task statuses.</li>
<li><strong>Dependency Management</strong>: Define and manage task dependencies effortlessly within your DAGs, ensuring proper execution order.</li>
<li><strong>Resource Allocation</strong>: Run Ray jobs in conjunction with other task types within a single pipeline, optimizing resource utilization.</li>
<li><strong>Granular Control</strong>: Use operators like SetupRayCluster, SubmitRayJob, and DeleteRayCluster to exert fine-grained control over the Ray cluster lifecycle.</li>
<li><strong>Optimized Lifecycle Management</strong>: Manage the full lifecycle of Ray clusters, including setup, execution, and teardown, to improve resource efficiency.</li>
</ul>


<h2>Overview:</h2>
<p>The Astro Python SDK is a Python SDK designed for rapid development of extract, transform, and load workflows in Apache Airflow. It simplifies workflow expression by managing data dependencies automatically. The SDK is maintained by Astronomer.</p>
<h2>Features:</h2>
<ul>
<li><strong>Rapid Development</strong>: Allows for quick development of ETL workflows in Apache Airflow.</li>
<li><strong>Data Dependency Management</strong>: Handles data dependencies, eliminating the need to manage ordering and tasks.</li>
<li><strong>Cloud Agnostic</strong>: Offers a cloud-agnostic version of the SDK for flexibility in cloud provider selection.</li>
</ul>
<h2>Summary:</h2>
<p>The Astro Python SDK simplifies ETL workflow development in Apache Airflow by managing data dependencies and eliminating the need to manually organize tasks. It is a valuable tool for developers looking to streamline their workflow creation process, especially in cloud environments.</p>


<h2>Overview</h2>
<p>The astronomer-fab-securitymanager is a specialized tool designed to enhance security management within the Astronomer Platform, particularly when integrated with Apache Airflow. This custom security manager offers a seamless way to validate JWT tokens and manage user roles automatically, ensuring that security protocols are followed efficiently.</p>
<p>By checking the roles claim from validated JWT tokens, the security manager ensures that users have the appropriate permissions while also keeping their existing roles intact. This tool is particularly useful for teams that require strict access controls and want to minimize administrative overhead.</p>
<h2>Features</h2>
<ul>
<li><strong>JWT Validation:</strong> Automatically validates JWT tokens from the Astronomer Platform, ensuring secure user access management.</li>
<li><strong>User Record Management:</strong> Creates or updates user records as necessary, streamlining the onboarding process for new users.</li>
<li><strong>Role Synchronization:</strong> Analyzes the roles claim of the JWT token to grant users the correct roles while maintaining any custom roles they may have.</li>
<li><strong>Stock Role Management:</strong> Efficiently removes any extra stock roles from existing users, allowing for clean role assignments without disrupting custom roles.</li>
<li><strong>Easy Configuration:</strong> Utilizes Airflow's configuration mechanism, making it straightforward to set up and customize via environment variables.</li>
<li><strong>Support for RBAC Mode:</strong> Designed to operate seamlessly with Airflow's Role-Based Access Control mode, enhancing both security and user experience.</li>
<li><strong>Inline Documentation:</strong> Comes with inline documentation for easy reference, ensuring developers can quickly understand and utilize all settings.</li>
<li><strong>Test Coverage:</strong> Supports running tests with coverage, contributing to better development practices and code quality.</li>
</ul>


<h2>Overview:</h2>
<p>The Astronomer Platform Helm Charts repository provides helm charts for deploying the Astronomer Platform on a Kubernetes cluster. Astronomer, a commercial "Airflow as a Service" platform, is designed to run on Kubernetes. Users can access the source code for the platform to inquire about licensing.</p>
<h2>Features:</h2>
<ul>
<li><strong>Architecture</strong>: Detailed information on the architecture of the Astronomer Platform.</li>
<li><strong>Docker images</strong>: Availability of Docker images for deploying and running Astronomer on Quay.io/Astronomer.</li>
<li><strong>Documentation</strong>: Access to platform documentation at https://docs.astronomer.io/enterprise.</li>
<li><strong>Contributing</strong>: Guidelines for reporting issues, bugs, and contributing to the project.</li>
<li><strong>Local Development</strong>: Information on setting up a local environment for chart development.</li>
<li><strong>Customization</strong>: Guide on customizing the local deployment of the platform.</li>
<li><strong>Testing</strong>: Instructions for locally testing HA configurations and utilizing environment variables.</li>
</ul>
<h2>Summary:</h2>
<p>The Astronomer Platform Helm Charts repository offers a comprehensive solution for deploying the Astronomer Platform on Kubernetes. With detailed information on architecture, Docker images, documentation access, contribution guidelines, and local development instructions, users can efficiently set up and customize their platform deployment. The provided guidance on customization, testing, and environment variables further enhances the deployment experience for developers and administrators.</p>


<h2>Overview</h2>
<p>Education Sandbox is an innovative environment designed for educators and learners to explore data orchestration and automation using tools like Apache Airflow and the Astro CLI. By integrating these powerful technologies, Education Sandbox provides a unique opportunity for users to become familiar with workflow management in a hands-on manner.</p>
<p>This platform is ideal for those looking to deepen their understanding of data pipelines and task management in an educational context. It promotes an interactive learning experience, allowing users to experiment and implement their ideas within a supportive framework.</p>
<h2>Features</h2>
<ul>
<li>
<p><strong>Intuitive Interface</strong>: The user-friendly interface of Education Sandbox makes it easy for users to navigate and utilize different features without a steep learning curve.</p>
</li>
<li>
<p><strong>Built-in Airflow Support</strong>: Seamlessly integrates with Apache Airflow, allowing users to create, schedule, and monitor workflows with ease.</p>
</li>
<li>
<p><strong>Astro CLI Integration</strong>: The inclusion of the Astro CLI gives users command-line access to manage their Airflow projects effectively, enhancing workflow efficiency.</p>
</li>
<li>
<p><strong>Collaborative Learning Environment</strong>: Education Sandbox encourages collaboration among users, fostering teamwork and knowledge sharing in the learning process.</p>
</li>
<li>
<p><strong>Real-time Feedback</strong>: Users receive instant feedback on their workflows, helping to identify issues and optimize task execution.</p>
</li>
<li>
<p><strong>Customizable Learning Paths</strong>: Tailor your learning experience based on your skill level and interests, ensuring a personalized approach to mastering data orchestration.</p>
</li>
<li>
<p><strong>Robust Documentation</strong>: Comprehensive resources and guides are available to assist users in leveraging the full capabilities of Education Sandbox.</p>
</li>
</ul>


<h2>Overview</h2>
<p>The Terraform Module for Astronomer designed for AWS is an innovative solution that simplifies the process of managing infrastructure through code. It allows users to efficiently provision and configure all the necessary components to run the Astronomer platform, enhancing the deployment and management experience significantly.</p>
<p>By utilizing Terraform, users can expect a seamless setup that integrates with AWS, providing robust features essential for a modern data platform. This module is specifically tailored for those looking to leverage the Astronomer platform while ensuring security, scalability, and ease of use in their infrastructure management.</p>
<h2>Features</h2>
<ul>
<li>
<p><strong>Private Kubernetes Cluster</strong>: Ensures a secure environment for running applications by keeping the cluster private and accessible only to authorized users.</p>
</li>
<li>
<p><strong>Aurora RDS Postgres</strong>: Provides a fully managed relational database service that supports Postgres, optimizing data management and scalability needs.</p>
</li>
<li>
<p><strong>Bastion Host</strong>: Facilitates secure administration of your cluster by acting as a gateway, allowing controlled access to the resources without exposing them directly to the internet.</p>
</li>
</ul>


<h2>Overview</h2>
<p>Terraform Module for Astronomer on Google Cloud Platform (GCP) is designed to simplify the deployment and management of the Astronomer platform. By utilizing Terraform, users can efficiently provision the necessary infrastructure as code, which enhances their ability to plan, create, and manage cloud resources seamlessly. This module is ideal for those looking to set up a robust environment for their data engineering needs with ease.</p>
<p>The powerful capabilities of Terraform paired with the Astronomer platform make it easier than ever to maintain a secure and scalable architecture on GCP. Whether you're setting up a private Kubernetes cluster or integrating with Cloud SQL, this module streamlines the entire process, reducing the complexity often associated with cloud resource management.</p>
<h2>Features</h2>
<ul>
<li><strong>Private Kubernetes cluster</strong>: Ensures that your applications are isolated and secure, providing a robust environment for container orchestration.</li>
<li><strong>Cloud SQL with Postgres</strong>: Offers a fully managed relational database service, making it easy to set up and manage your database needs.</li>
<li><strong>Bastion host for secure cluster administration</strong>: Adds an extra layer of security by allowing controlled access to your Kubernetes cluster, safeguarding against unauthorized access.</li>
<li><strong>Architecture</strong>: Tailored specifically for Astronomer, this setup optimizes your cloud environment to support your data workflows effectively.</li>
<li><strong>Requires Terraform 0.13+</strong>: Ensures compatibility with the latest features and improvements in Terraform, providing a top-notch infrastructure management tool.</li>
<li><strong>GitHub Release and Build Status</strong>: Keeps users informed about the latest updates and stability of the module, ensuring they have access to the most reliable version.</li>
</ul>


<h2>Overview</h2>
<p>The Astro Terraform Import Script offers an effective solution for those looking to streamline their resource management within the Astro platform. By simplifying the process of importing existing resources into Terraform configurations, this tool caters to both newcomers and seasoned users aiming to optimize their setup. The ability to manage essential components like workspaces and API tokens directly through Terraform presents a flexible and efficient approach for organizations.</p>
<p>With the script, users can easily generate the necessary Terraform import blocks and configurations, ensuring a smooth transition from manual setups to fully automated infrastructure as code. Whether you're aiming to enhance your deployment processes or simply wish to utilize existing resources, the Astro Terraform Import Script is designed to accommodate your needs.</p>
<h2>Features</h2>
<ul>
<li><strong>Easy Resource Importing</strong>: The script automates the generation of import blocks for various resources, including workspaces, deployments, and teams, significantly reducing manual effort.</li>
<li><strong>API Token Integration</strong>: Users can authenticate seamlessly using an API token, ensuring secure access to the Astro platform while managing resources.</li>
<li><strong>Detailed Output Files</strong>: After running the script, it generates two key files (<code>import.tf</code> and <code>generated.tf</code>), which house the import configurations and resource definitions, respectively.</li>
<li><strong>Flexible Organization Support</strong>: Users need to specify the Organization ID for importing resources, ensuring that configurations are properly tailored to their organizational structure.</li>
<li><strong>Customization Readiness</strong>: The generated Terraform configurations are readily adjustable, allowing users to fine-tune each resource to meet their specific requirements.</li>
<li><strong>Comprehensive Instructions</strong>: The script includes extensive help documentation and commands, making it user-friendly regardless of technical expertise.</li>
<li><strong>Terraform Compatibility</strong>: Designed to work with Terraform versions 1.7 and above, ensuring users can leverage the latest features and improvements.</li>
<li><strong>Active Troubleshooting Support</strong>: The FAQ section addresses common issues, such as authentication errors, providing users with guidance when needed.</li>
</ul>


Astronomer

Ask Astro

Astro Cli

Astro Provider Databricks

Astro Provider Ray

Astro Sdk

Astronomer Cosmos

Astronomer Fab Securitymanager

Astronomer Providers

Astronomer

Education Sandbox

Terraform Aws Astronomer Aws

Terraform Google Astronomer Gcp

Terraform Provider Astro