Deployment Engine for the OSDU® Data Platform is an effective solution aimed at simplified deploying of OSDU® Data Platform into any Google Cloud project and various software for it.
Deployment Engine for the OSDU® Data Platform has an intuitive, user-friendly interface that empowers to configure and deploy an ideal OSDU® instance with just a few clicks according to business needs.
Streamline your energy data management by deploying OSDU® (Open Subsurface Data Universe) instances on Google Cloud with unparalleled speed and simplicity. The Deployment Engine for OSDU® Data Platform is a powerful tool that automates the entire setup process, allowing you to launch a fully configured, production-ready environment in just 1-2 hours, and a demo environment in 10-60 mins.
Key Features
Versatile Deployment Options:
- OSDU® instance type (Google Cloud-based instance or a Community Implementation),
- Deployment tier (Dev, Stage, or Production),
- Region for deploying an OSDU® instance and other solutions,
- Bootstrapping data for testing purposes,
- Deploying any non-core OSDU® component (DDMS services, GCZ, EDS, etc) as an option,
- Deploying extra services (Admin UI, Jupyter notebooks, Cloud Data connector, etc),
- Deployment parameters (custom domain, shared VPC, external Elasticsearch connection, external Google Cloud Composer, etc).
Tailored Infrastructure Tiers. Multiple predefined tiers with varying resource allocations to ensure the perfect performance profile for specific workloads.
Comprehensive Deployment Insights. Full visibility of an instance with detailed information on status, estimated completion time, and all service endpoints once deployed.
Simplified Management. Deprovisioning an OSDU® instance or perform a complete cleanup of all associated resources from a Google Cloud project with a single click.
Automated Security. The engine automatically generates a unique service account with the necessary IAM roles and permissions, ensuring a deployed solution adheres to security best practices from the start.
Transparent deployment. Deployment Engine provides various reports demonstrating all the details about the deployed and non-deployed components, the quality analysis and other reports about the deployed solution.
Managing access from Deployment Engine to the Google Cloud project via service account is on the user side.
Preliminary calculations for infrastructure for every option of deployments.
Core Benefits
Simplified & Accelerated Deployment: Get your OSDU® instance up and running in a fraction of the time, reducing deployment from weeks to just a couple of hours and even minutes.
Flexible Configurations: Customize your environment by choosing the ideal infrastructure tier and additional services to meet your organization's unique requirements.
Automated Resource Provisioning: Eliminate the time-consuming and error-prone task of manual resource setup. The Deployment Engine handles all provisioning and configuration for you.
Secure by Default: Benefit from automatically generated infrastructure with a set of pre-configured settings, appropriate permissions, reducing security risks.
Pre-Configured Environments: Save valuable time and effort with environments optimized for common industry use cases.
Whether you are a data scientist, engineer, or developer in the energy sector, the Deployment Engine for OSDU® Data Platform provides the most efficient and seamless path to leveraging the power of the OSDU® Data Platform on Google Cloud.
Get started
There are 2 options how to get access to Deployment Engine for the OSDU® Data Platform:
- Sign-up via Google Marketplace offering
- Sign-up via Deployment Engine for the OSDU® Data Platform.
Follow instructions to sign-up in Deployment Engine.
Deployments
The following pages have the details about the OSDU® Services & DAGs:
Additional details for OSDU® Google Cloud and Community Implementation which are deployed via Deployment Engine are described in the next section.
OSDU services & DAGs
Deployment Engine deploys OSDU® services and DAGs. The services and DAGs can be
- mandatory (will be deployed in any deployment)
- optional (will be deployed as an option or will be added in the deployment in future) or
- not available.
| Name | Capability / Service Group | Maturity | Google Cloud Deployment | Community Implementaton Deployment |
|---|---|---|---|---|
| Dataset | Core | Graduated | mandatory | mandatory |
| Entitlements | Core | Graduated | mandatory | mandatory |
| File | Core | Graduated | mandatory | mandatory |
| Indexer | Core | Graduated | mandatory | mandatory |
| Legal | Core | Graduated | mandatory | mandatory |
| Notification | Core | Graduated | optional | mandatory |
| Partition | Core | Graduated | mandatory | mandatory |
| Policy | Core | Graduated | optional | N/A |
| Register | Core | Graduated | optional | mandatory |
| Schema | Core | Graduated | mandatory | mandatory |
| Search | Core | Graduated | mandatory | mandatory |
| Storage | Core | Graduated | mandatory | mandatory |
| Secret | Core | Incubator | mandatory | mandatory |
| Project & Workflow Service | Core | Incubator | N/A | N/A |
| CRS Catalog | References & Helper | Graduated | mandatory | mandatory |
| CRS Conversion | References & Helper | Graduated | mandatory | mandatory |
| Unit | References & Helper | Graduated | mandatory | mandatory |
| Schema Upgrade | References & Helper | Graduated | optional | N/A |
| Cloud Data Connector | References & Helper | Graduated | optional | N/A |
| Seismic DDMS | DDMS | Graduated | optional | mandatory |
| Wellbore DDMS | DDMS | Graduated | optional | mandatory |
| Reservoir DDMS | DDMS | Graduated | optional | N/A |
| Production DDMS - Historian | DDMS | Incubator | N/A | N/A |
| Well Delivery DDMS | DDMS | Sandbox | optional | mandatory |
| Rock and Fluid Sample DDMS | DDMS | Sandbox | optional | mandatory |
| Production DDMS - Core | DDMS | Sandbox | optional | N/A |
| Workflow Service | Ingestion Services | Graduated | mandatory | mandatory |
| CSV Parser DAG | Ingestion Services | Graduated | mandatory | N/A |
| Manifest-based Ingestion DAG | Ingestion Services | Graduated | mandatory | N/A |
| SegY-to-oZGY DAG | Ingestion Services | Graduated | mandatory | N/A |
| SegY-to-oVDS DAG | Ingestion Services | Graduated | mandatory | N/A |
| EDS DMS Service | Ingestion Services | Graduated | optional | N/A |
| EDS Fetch & Ingest DAG | Ingestion Services | Graduated | mandatory | N/A |
| EDS Scheduler DAG | Ingestion Services | Graduated | mandatory | N/A |
| Manifest Ingestion by Reference DAG | Ingestion Services | Sandbox | N/A | N/A |
| WITSML Parser DAG | Ingestion Services | Sandbox | N/A | N/A |
| EDS Naturalization DAG | Ingestion Services | Sandbox | mandatory | N/A |
| Energistcs Parser DAG | Ingestion Services | Sandbox | N/A | N/A |
| Energyml Converter | Ingestion Services | Sandbox | mandatory | N/A |
| Energyml Delivery | Ingestion Services | Sandbox | mandatory | N/A |
| WITSML Parser v2 | Ingestion Services | Sandbox | N/A | N/A |
| Resqml Parser | Ingestion Services | Sandbox | N/A | N/A |
| ProdML Parser | Ingestion Services | Sandbox | N/A | N/A |
| GCZ | Consumption Zones | Graduated | optional | N/A |
| Config | References & Helper | Sandbox | optional | mandatory |
Deployment options
- Region
- Google Cloud Project ID
- Admin email
- Service account
- Backup & Restore
- Custom domains
- Shared VPC
- Admin UI
- External Elasticsearch
- Bootstrap Data
- Optional OSDU Services