🚀 Excited to open-source IntelliHybrid — my latest project solving one of enterprise IT's most persistent headaches: securely connecting on-premise databases to AWS cloud.
After working with hybrid cloud architectures at scale, I kept seeing the same painful pattern:
❌ Custom scripts that break when someone changes the DB schema
❌ VPN configurations done manually and never documented
❌ No single source of truth for what's syncing where
❌ Security misconfigurations that put data at risk
So I built IntelliHybrid — a config-driven framework that eliminates all of that.
What it does:
✅ Establishes encrypted VPN tunnels (Site-to-Site, OpenVPN, Direct Connect)
✅ Auto-provisions DynamoDB tables with your custom PK/SK schema — from a single YAML
✅ Connects any on-prem database (MySQL, PostgreSQL, Oracle, SQL Server)
✅ Runs continuous bidirectional sync — on-prem ↔ AWS DynamoDB
✅ KMS encryption, IAM least-privilege, TLS everywhere — security-first by design
The magic: Zero code changes after setup. Everything is config.
# That's it. This creates your DynamoDB table:
dynamodb:
tables:
- name: orders-table
partition_key: { name: orderId, type: S }
sort_key: { name: createdAt, type: N }📦 Open source. Free. MIT licensed.
⭐ GitHub: https://github.com/Clever-Boy/IntelliHybrid
📖 How-To-Use Booklet included for quick setup
If you're dealing with hybrid cloud integration challenges, this might save you weeks of work.
Would love your feedback, stars ⭐, and contributions!
#HybridCloud #AWS #DynamoDB #CloudIntegration #OpenSource #Python #DevOps #CloudMigration #Infrastructure #AWS #DataEngineering
🔐 How do you securely connect your on-premise Oracle database to AWS DynamoDB without writing a single line of custom integration code?
Here's the 3-step answer with IntelliHybrid:
Step 1: Configure once
onprem:
database:
type: oracle
host: 192.168.1.100
port: 1521
name: PROD_DB
username: "${DB_USER}" ← env variable, never hardcoded
password: "${DB_PASSWORD}"
vpn:
type: site-to-site
customer_gateway_ip: "203.0.113.10"Step 2: Initialize (one command)
intellihybrid init --config config/config.yaml→ VPN tunnel: established ✅
→ DynamoDB tables: created with KMS encryption ✅
→ Database: connected ✅
Step 3: Sync
intellihybrid sync --mode bidirectionalThat's the whole workflow.
Under the hood, IntelliHybrid handles:
🔑 IAM role creation with least-privilege access
🔒 KMS encryption for all DynamoDB tables
🛡️ TLS 1.3 for all data in transit
🔄 Change detection via SHA-256 fingerprinting (no unnecessary writes)
♻️ Automatic retry and connection pooling
The project is on Zenodo for academic citation tracking, so if you use it in research or your org's architecture, there's a formal DOI you can reference.
⭐ Star it if this solves a real problem for you: https://github.com/Clever-Boy/IntelliHybrid
#AWS #DynamoDB #HybridCloud #CloudArchitecture #Python #OpenSource #DataEngineering #CloudSecurity #DevOps
💡 A question for my network in cloud architecture:
What's your biggest pain point when it comes to hybrid cloud data integration?
I recently open-sourced a tool that addresses what I see as the top 3 challenges:
1️⃣ Security — credentials leaking into config files, overly broad IAM policies
2️⃣ Schema drift — on-prem schema changes breaking cloud pipelines
3️⃣ Operational overhead — too many manual steps to set up VPN + DB + cloud tables
IntelliHybrid (https://github.com/Clever-Boy/IntelliHybrid) tackles all three with a single YAML config. It supports MySQL, PostgreSQL, Oracle, SQL Server → AWS DynamoDB, with automatic VPN provisioning.
Curious to hear: what approach does your team take for on-prem ↔ cloud integration today?
Drop your thoughts in the comments 👇 — always looking to improve the tool based on real-world use cases.
#CloudIntegration #AWS #HybridCloud #DataEngineering #OpenSource #CloudArchitecture
Tweet 1: Just open-sourced IntelliHybrid 🚀
Connect any on-prem database to AWS DynamoDB in under 5 minutes: → Auto-provisions DynamoDB tables from YAML (custom PK/SK) → Handles VPN, IAM, KMS encryption automatically → Bidirectional sync, zero code required
⭐ https://github.com/Clever-Boy/IntelliHybrid
#AWS #OpenSource #HybridCloud
Tweet 2: Tired of custom scripts for on-prem → cloud sync?
IntelliHybrid uses one config file to: ✅ Establish VPN tunnel ✅ Create DynamoDB tables (with your PK/SK) ✅ Start bidirectional sync
MIT license. Free forever. https://github.com/Clever-Boy/IntelliHybrid
Tweet 3: Security-first hybrid cloud integration:
🔐 KMS encryption on all DynamoDB tables 🔒 TLS 1.3 everywhere 🛡️ Least-privilege IAM auto-generated 🔑 Secrets only via env vars — never in config files
IntelliHybrid: https://github.com/Clever-Boy/IntelliHybrid
Title: "How I Built a Configuration-Driven Hybrid Cloud Connector for On-Prem to AWS DynamoDB"
Sections:
- The Problem — Why hybrid cloud integration is painful
- Architecture Overview — On-prem DB → VPN → DynamoDB
- The Config-Driven Approach — Why YAML beats custom code
- Security Design — KMS, TLS, IAM, no hardcoded secrets
- DynamoDB Table Provisioning — Custom PK/SK from config
- Bidirectional Sync — Change detection with fingerprinting
- How to Use It — 5-minute quickstart
- What's Next — CDC streaming, MongoDB, Terraform module
Call to action: ⭐ Star on GitHub + try it out
Title: "Open-sourced a tool that connects on-prem databases to DynamoDB via VPN in one config file"
Body: Hey r/aws,
I've been working on hybrid cloud architectures for a while and kept hitting the same wall — getting on-prem databases securely connected to AWS services requires a lot of glue code, manual VPN setup, and careful IAM configuration.
So I built IntelliHybrid. Here's what it does:
- VPN auto-provisioning: Describe your setup in YAML, it creates the Customer Gateway and Virtual Private Gateway in AWS via API
- DynamoDB table creation: Define PK, SK, GSIs in config — tables are auto-created with KMS encryption and PITR
- Database support: MySQL, PostgreSQL, Oracle, SQL Server
- Bidirectional sync: On-prem → DynamoDB and DynamoDB → on-prem, continuously
- Security built-in: No secrets in config files (env var resolution), TLS, least-privilege IAM
GitHub: https://github.com/Clever-Boy/IntelliHybrid
Happy to answer questions or take feedback on the architecture. Looking for contributors too!
Name: IntelliHybrid
Tagline: Connect on-premise databases to AWS DynamoDB in one YAML config
Description: IntelliHybrid eliminates the pain of hybrid cloud integration. Define your on-prem database, VPN details, and DynamoDB table schemas in a single YAML file — IntelliHybrid handles everything else: VPN tunnel provisioning, table creation with your custom PK/SK, IAM roles, KMS encryption, and continuous bidirectional data sync. Supports MySQL, PostgreSQL, Oracle, and SQL Server. Open source, MIT licensed.
Topics: Developer Tools, Cloud, Open Source, AWS, DevOps
Subject: Open-source tool for on-prem → AWS DynamoDB integration
Hi [Name],
I noticed your team works with hybrid cloud architectures. I recently open-sourced a tool that might be relevant — IntelliHybrid.
It's a configuration-driven framework that securely connects on-premise databases (MySQL, PostgreSQL, Oracle, SQL Server) to AWS DynamoDB through an encrypted VPN tunnel, with automatic table provisioning and bidirectional sync — all from a single YAML config file.
GitHub: https://github.com/Clever-Boy/IntelliHybrid How-To-Use Guide: https://github.com/Clever-Boy/IntelliHybrid/blob/main/docs/HOW_TO_USE.md
Would love your feedback if it's useful for your use case.
Best, Shailesh Kadam