Pigsty v2.7.0

Highlights

New powerful extensions, especially Rust/pgrx-developed ones:

• pg_search v0.7.0: BM25 full-text search
• pg_lakehouse v0.7.0: Object storage/table format query engine
• pg_analytics v0.6.1: Accelerated analytics
• pg_graphql v1.5.4: GraphQL support
• pg_jsonschema v0.3.1: JSON Schema validation
• wrappers v0.3.1: Supabase FDW collection
• pgmq v1.5.2: Lightweight message queue
• pg_tier v0.0.3: S3 cold storage tiering
• pg_vectorize v0.15.0: RAG wrapper
• pg_later v0.1.0: Async SQL execution
• pg_idkit v0.2.3: UUID generation
• plprql v0.1.0: PRQL language
• pgsmcrypto v0.1.0: Chinese SM cryptography
• pg_tiktoken v0.0.1: OpenAI token counting
• pgdd v0.5.2: Catalog metadata via SQL

C/C++ extensions:

• parquet_s3_fdw 1.1.0: S3 Parquet lakehouse
• plv8 3.2.2: JavaScript stored procedures
• md5hash 1.0.1: Native MD5 hash type
• pg_tde 1.0-alpha: Experimental encryption
• pg_dirtyread 2.6: Read dead tuples

New Features

• Allow Pigsty to run in Docker VM images
• ARM64 packages for INFRA & PGSQL modules on Ubuntu and EL
• New installer script with Cloudflare download, version specification, better prompts
• PGSQL PITR dashboard for PITR observability
• Guardrails to prevent running playbooks on unmanaged nodes
• Per-distro config files: el7, el8, el9, debian11, debian12, ubuntu20, ubuntu22

Docker App Templates

• Odoo: Open-source ERP
• Jupyter: Jupyter Notebook container
• PolarDB: “Domestic database” for compliance
• Supabase: Updated to latest GA
• Bytebase: Using latest tag
• pg_exporter: Updated Docker examples

Software Upgrades

• PostgreSQL 16.3
• Patroni 3.3.0
• pgBackRest 2.51
• VIP-Manager v2.5.0
• HAProxy 2.9.7
• Grafana 10.4.2
• Prometheus 2.51
• Loki & Promtail: 3.0.0 (Warning: breaking changes!)
• Alertmanager 0.27.0
• BlackBox Exporter 0.25.0
• Node Exporter 1.8.0
• pgBackRest Exporter 0.17.0
• DuckDB 0.10.2
• etcd 3.5.13
• minio-20240510014138 / mcli-20240509170424
• pev2 v1.8.0 -> v1.11.0
• pgvector 0.6.1 -> 0.7.0
• pg_tle: v1.3.4 -> v1.4.0
• hydra: v1.1.1 -> v1.1.2
• duckdb_fdw: v1.1.0 recompiled for libduckdb 0.10.2
• pg_bm25 0.5.6 -> pg_search 0.7.0
• pg_analytics: 0.5.6 -> 0.6.1
• pg_graphql: 1.5.0 -> 1.5.4
• pg_net 0.8.0 -> 0.9.1
• pg_sparse (deprecated)

Bug Fixes

• Fixed variable whitespace in pg_exporters role
• Fixed minio_cluster not commented in global config
• Fixed EL7 template postgis34 should be postgis33
• Fixed EL8 python3.11-cryptography dependency renamed to python3-cryptography
• Fixed /pg/bin/pg-role not getting OS username in non-interactive shell
• Fixed /pg/bin/pg-pitr not prompting -X -P options correctly

API Changes

• New node_write_etc_hosts parameter for controlling /etc/hosts writes
• New prometheus_sd_dir parameter for Prometheus static discovery directory
• Configure script adds -x|--proxy for writing proxy info
• Stopped parsing Nginx log detail labels in Promtail/Loki to avoid label cardinality explosion
• Using Alertmanager API v2 instead of v1
• Using /pg/cert/ca.crt instead of /etc/pki/ca.crt in PGSQL module

Offline Package Checksums

MD5 (pigsty-pkg-v2.7.0.el8.x86_64.tgz) = ec271a1d34b2b1360f78bfa635986c3a
MD5 (pigsty-pkg-v2.7.0.debian12.x86_64.tgz) = f3304bfd896b7e3234d81d8ff4b83577
MD5 (pigsty-pkg-v2.7.0.ubuntu22.x86_64.tgz) = 5b071c2a651e8d1e68fc02e7e922f2b3

Sources

• GitHub release
• Pigsty v2.7 release article
• Historical About / Release Note
• Source comparison: v2.6.0...v2.7.0