Connector Fixes, Core API Enhancements, and Ecosystem Updates: Apache SeaTunnel’s Progress in November

Source: Dev.to

Overview

To all Apache SeaTunnel enthusiasts—the November Community Report is here!

In November, Apache SeaTunnel delivered improvements across connector stability, core features, documentation, and the broader ecosystem. The community resolved multiple critical issues, strengthened various connectors, and introduced several production‑grade capabilities such as the Pending Queue Query API, TIMESTAMP_TZ support, and ViewFs integration. Documentation also saw continued refinement, ecosystem compatibility expanded, and overall stability and usability reached new levels. Community activity remained strong, with numerous contributors driving rapid project evolution.

Monthly Highlights

Connector Enhancements

• Key issues fixed across multiple connectors
• Added support for TIMESTAMP_TZ, HugeGraph Sink, ViewFs, and more
• Improved JSON nested parsing and optimized MySQL sharding strategies

Core Feature Upgrades

• Introduced the Pending Queue Query API
• Overview now displays PendingJobs information
• Comprehensive updates to the testing framework and base images

Documentation & Ecosystem

• Expanded and improved connector documentation and upgrade guides
• Updated MongoDB and Transforms documentation
• Added new ecosystem content such as SeaTunnel MCP

Community Activity

• 15+ contributors merged changes
• Continued strong momentum across the project

Monthly Merge Stars

A big thank‑you to the following contributors for their outstanding work last month (in no particular order):

@loupipalien, @chl-wxp, @dybyte, @zhan7236, @misi1987107, @wuxiansen, @LiJie20190102, @liunaijie, @corgy-w, @yzeng1618, @Adamyuanyuan, @zhangshenghang, @wgzhao, @xiaochen-zhou, @Gfreely

Pull Request Summary

Fixes

• [Bug][Connector-V2][Email] Fix NPE on null values, add configurable attachment name and delimiter – @zhan7236
• [Fix][Connector-v2][Doris] Array type data parsing failed – @zhangshenghang
• [Hotfix][CI] Fix TestSQLIT – @dybyte
• [Fix][doc] Add missing closing braces in SqlServer‑CDC documentation – @wgzhao
• [Fix][Connector-V2][Clickhouse] Add primary key support in ClickhouseSourceFactory – @zhangshenghang
• [Bugfix][seatunnel-e2e] Increase timeout – @chl-wxp
• [Fix][Connector-v2][MongoDB‑CDC] When starting multiple tasks to connect to different MongoDB services, only the first one takes effect – @zhangshenghang
• [Fix][Connector-V2][Http] Fix setting of HTTP parameters in HttpSink.java – @zhangshenghang
• [Bugfix][seatunnel-connectors-v2][connector-elasticsearch] ElasticsearchSink encounters a writing error and the task does not exit – @chl-wxp
• [Fix][Connector-v2][Clickhouse] Support clickhouse log engine – @zhangshenghang
• [Fix][seatunnel-spark-starter] Fix when Spark submits tasks in the fo… – @LiJie20190102
• [Fix][Transform] Fix ClassCastException in SQL Transform with TRIM(Expression) – @corgy-w
• [Fix][Connecotr][Hive] Correct password parameter assignment in HiveJdbcConnectionProvider – @zhangshenghang
• [Fix][e2e] Fix flaky Redis tests – @dybyte
• [Fix][Core] Update JDK Docker image version – @zhangshenghang
• [Fix][Connector-v2][Clickhouse] Use actual table schema instead of DESC results for PhysicalColumn creation – @zhangshenghang
• [Fix][Connector-v2][Clickhouse] Fix filter_query not working in SQL batch read strategy – @zhangshenghang
• [Fix] Logs HTTP basic issue #9755 – @wuxiansen
• [Fix][Connector-V2] Ignore JdbcConnectorException on JDBC statement close – @dybyte

Improvements

• [Improve][Connector-V2][WeChat] Optimize StringBuffer to StringBuilder for better performance – @corgy-w
• [Feature][Connector-V2] Support HDFS ViewFs Schema – @xiaochen-zhou
• [Improve][Docs] Supplement Chinese documentation for SeaTunnel connectors – @yzeng1618
• [Improve][Flink] NO_CDC source support checkpoint – @yzeng1618
• [Feature][Core] Add REST API for viewing Pending queue details – @zhangshenghang
• [Improve][e2e] Change Docker images to use seatunnelhub repository – @zhangshenghang
• [Improve][Docs] Add incompatible changes documentation for version upgrades – @dybyte
• [Improve][seatunnel-connectors-v2][connector-mongodb] Improve MongodbWriter close – @chl-wxp
• [Feature][Connector-V2] PostgreSQL support read TIMESTAMP_TZ – @yzeng1618
• [Improve][E2E] Update JDK Docker image to seatunnelhub – @zhangshenghang
• [Improve][Connector-V2][HBase] Support configurable range‑scan boundary inclusion policies – @zhangshenghang
• [Feature][Connector-V2] Support sink connector for Apache HugeGraph – @Gfreely
• [Improve] Support JSON multi‑level nested parsing – @misi1987107
• [Feature][Connector-V2] Support the dynamic options of the Paimon table read – @xiaochen-zhou
• [Improve][Connector-v2][MySQL] Optimize shard calculation strategy – @zhangshenghang
• [Feature][Connector-V2][Milvus] Sink writer flush by interval – @loupipalien
• [Improve][E2E] Improve Redis test for delete hash – @chl-wxp
• [Feature][Core] Add PendingJobs info in the response of GetOverviewOperation – @xiaochen-zhou
• [Feature][Connector-V2] Hive sink support SchemaSaveMode and DataSaveMode – @yzeng1618

Others

• [Add][Docs] Introduce SeaTunnel MCP and x2SeaTunnel documentation on website – @Adamyuanyuan
• [Improve][Connector-v2][MySQL-CDC] Schema evolution optimization waiting time – (incomplete entry)