Vitess v22.0.0-rc2

Release of Vitess v22.0.0

Summary

Table of Contents

• Major Changes
  • Deprecations
    • Metrics
    • CLI Flags
  • Deletions
    • Metrics
    • CLI Flags
    • gh-ost and pt-osc Online DDL strategies
  • New Metrics
    • VTGate
    • VTTablet
  • Config File Changes
    • VTOrc
    • VTGate
  • VTOrc
    • Stalled Disk Recovery
    • KeyRanges in --clusters_to_watch
  • New Default Versions
    • MySQL 8.0.40
    • Docker vitess/lite images with Debian Bookworm
  • New Support
    • More Efficient JSON Replication
    • LAST_INSERT_ID(x)
    • Maximum Idle Connections in the Pool
    • Filtering Query logs on Error
    • MultiQuery RPC in vtgate
    • Unsharded CREATE PROCEDURE support
  • Optimization
    • Prepared Statement
  • RPC Changes
  • Prefer not promoting a replica that is currently taking a backup
  • Semi-sync monitor in vttablet
  • Wrapped fatal transaction errors
• Minor Changes
  • Topology read concurrency behaviour changes
  • VTTablet
    • CLI Flags
    • ACL enforcement and reloading
  • VTAdmin
    • Updated to node v22.13.1

Major Changes

Deprecations

Metrics

Component	Metric Name	Deprecation PR
vtgate	QueriesProcessed	#17727
vtgate	QueriesRouted	#17727
vtgate	QueriesProcessedByTable	#17727
vtgate	QueriesRoutedByTable	#17727

CLI Flags

Component	Flag Name	Notes	Deprecation PR
vttablet	twopc_enable	Usage of TwoPC commit will be determined by the transaction_mode set on VTGate via flag or session variable.	#17279
vtgate	grpc-send-session-in-streaming	Session will be sent as part of response on StreamExecute API call.	#17907

---

Deletions

Metrics

Component	Metric Name	Was Deprecated In	Deprecation PR
vttablet	QueryCacheLength	v21.0.0	#16289
vttablet	QueryCacheSize	v21.0.0	#16289
vttablet	QueryCacheCapacity	v21.0.0	#16289
vttablet	QueryCacheEvictions	v21.0.0	#16289
vttablet	QueryCacheHits	v21.0.0	#16289
vttablet	QueryCacheMisses	v21.0.0	#16289

CLI Flags

Component	Flag Name	Was Deprecated In	Deprecation PR
vttablet	queryserver-enable-settings-pool	v21.0.0	#16280
vttablet	remove-sharded-auto-increment	v21.0.0	#16860
vttablet	disable_active_reparents	v20.0.0	#14871
vtgate, vtcombo, vtctld	healthcheck-dial-concurrency	v21.0.0	#16378

gh-ost and pt-osc Online DDL strategies

Vitess no longer recognizes the gh-ost and pt-osc (pt-online-schema-change) Online DDL strategies. The vitess strategy is the recommended way to make schema changes at scale. mysql and direct strategies continue to be supported.

These vttablet flags have been removed:

• --gh-ost-path
• --pt-osc-path

The use of gh-ost and pt-osc as strategies as follows, yields an error:

$ vtctldclient ApplySchema --ddl-strategy="gh-ost" ...
$ vtctldclient ApplySchema --ddl-strategy="pt-osc" ...

---

New Metrics

VTGate

Name	Dimensions	Description	PR
QueryExecutions	Query, Plan, Tablet	Number of queries executed.	#17727
QueryRoutes	Query, Plan, Tablet	Number of vttablets the query was executed on.	#17727
QueryExecutionsByTable	Query, Table	Queries executed at vtgate, with counts recorded per table.	#17727
VStreamsCount	Keyspace, ShardName, TabletType	Number of active vstream.	#17858
VStreamsEventsStreamed	Keyspace, ShardName, TabletType	Number of events sent across all vstreams.	#17858
VStreamsEndedWithErrors	Keyspace, ShardName, TabletType	Number of vstreams that ended with errors.	#17858
CommitModeTimings	Mode	Timing metrics for commit (Single, Multi, TwoPC).	#16939
CommitUnresolved	N/A	Counter for failure after Prepare.	#16939

The work done in #17727 introduces new metrics for queries. Via this work we have deprecated several vtgate metrics, please see the Deprecated Metrics section. Here is an example on how to use them:

Query: select t1.a, t2.b from t1 join t2 on t1.id = t2.id
Shards: 2
Sharding Key: id for both tables

Metrics Published:
1. QueryExecutions – {select, scatter, primary}, 1
2. QueryRoutes – {select, scatter, primary}, 2
3. QueryExecutionsByTable – {select, t1}, 1 and {select, t2}, 1

VTTablet

Name	Dimensions	Description	PR
TableRows	Table	Estimated number of rows in the table.	#17570
TableClusteredIndexSize	Table	Byte size of the clustered index (i.e. row data).	#17570
IndexCardinality	Table, Index	Estimated number of unique values in the index	#17570
IndexBytes	Table, Index	Byte size of the index.	#17570
UnresolvedTransaction	ManagerType	Number of events sent across all vstreams.	#16939
CommitPreparedFail	`...

Vitess v21.0.4

Release of Vitess v21.0.4

The entire changelog for this release can be found here.

The release includes 35 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @dbussink, @frouioui, @harshit-gangal, @mattlord, @systay, @vitess-bot

Vitess v20.0.7

Release of Vitess v20.0.7

The entire changelog for this release can be found here.

The release includes 27 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @dbussink, @harshit-gangal, @systay, @vitess-bot

Vitess v22.0.0-rc1

Release of Vitess v22.0.0

Summary

Table of Contents

• Major Changes
  • Deprecations
    • Metrics
    • CLI Flags
  • Deletions
    • Metrics
    • CLI Flags
    • gh-ost and pt-osc Online DDL strategies
  • New Metrics
    • VTGate
    • VTTablet
  • Config File Changes
    • VTOrc
    • VTGate
  • VTOrc
    • Stalled Disk Recovery
    • KeyRanges in --clusters_to_watch
  • New Default Versions
    • MySQL 8.0.40
    • Docker vitess/lite images with Debian Bookworm
  • New Support
    • More Efficient JSON Replication
    • LAST_INSERT_ID(x)
    • Maximum Idle Connections in the Pool
    • Filtering Query logs on Error
  • Optimization
    • Prepared Statement
  • RPC Changes
  • Prefer not promoting a replica that is currently taking a backup
  • Semi-sync monitor in vttablet
  • Wrapped fatal transaction errors
• Minor Changes
  • Topology read concurrency behaviour changes
  • VTTablet
    • CLI Flags
    • ACL enforcement and reloading
  • VTAdmin
    • Updated to node v22.13.1

Major Changes

Deprecations

Metrics

Component	Metric Name	Deprecation PR
vtgate	QueriesProcessed	#17727
vtgate	QueriesRouted	#17727
vtgate	QueriesProcessedByTable	#17727
vtgate	QueriesRoutedByTable	#17727

CLI Flags

Component	Flag Name	Notes	Deprecation PR
vttablet	twopc_enable	Usage of TwoPC commit will be determined by the transaction_mode set on VTGate via flag or session variable.	#17279
vtgate	grpc-send-session-in-streaming	Session will be sent as part of response on StreamExecute API call.	#17907

---

Deletions

Metrics

Component	Metric Name	Was Deprecated In	Deprecation PR
vttablet	QueryCacheLength	v21.0.0	#16289
vttablet	QueryCacheSize	v21.0.0	#16289
vttablet	QueryCacheCapacity	v21.0.0	#16289
vttablet	QueryCacheEvictions	v21.0.0	#16289
vttablet	QueryCacheHits	v21.0.0	#16289
vttablet	QueryCacheMisses	v21.0.0	#16289

CLI Flags

Component	Flag Name	Was Deprecated In	Deprecation PR
vttablet	queryserver-enable-settings-pool	v21.0.0	#16280
vttablet	remove-sharded-auto-increment	v21.0.0	#16860
vttablet	disable_active_reparents	v20.0.0	#14871
vtgate, vtcombo, vtctld	healthcheck-dial-concurrency	v21.0.0	#16378

gh-ost and pt-osc Online DDL strategies

Vitess no longer recognizes the gh-ost and pt-osc (pt-online-schema-change) Online DDL strategies. The vitess strategy is the recommended way to make schema changes at scale. mysql and direct strategies continue to be supported.

These vttablet flags have been removed:

• --gh-ost-path
• --pt-osc-path

The use of gh-ost and pt-osc as strategies as follows, yields an error:

$ vtctldclient ApplySchema --ddl-strategy="gh-ost" ...
$ vtctldclient ApplySchema --ddl-strategy="pt-osc" ...

---

New Metrics

VTGate

Name	Dimensions	Description	PR
QueryExecutions	Query, Plan, Tablet	Number of queries executed.	#17727
QueryRoutes	Query, Plan, Tablet	Number of vttablets the query was executed on.	#17727
QueryExecutionsByTable	Query, Table	Queries executed at vtgate, with counts recorded per table.	#17727
VStreamsCount	Keyspace, ShardName, TabletType	Number of active vstream.	#17858
VStreamsEventsStreamed	Keyspace, ShardName, TabletType	Number of events sent across all vstreams.	#17858
VStreamsEndedWithErrors	Keyspace, ShardName, TabletType	Number of vstreams that ended with errors.	#17858
CommitModeTimings	Mode	Timing metrics for commit (Single, Multi, TwoPC).	#16939
CommitUnresolved	N/A	Counter for failure after Prepare.	#16939

The work done in #17727 introduces new metrics for queries. Via this work we have deprecated several vtgate metrics, please see the Deprecated Metrics section. Here is an example on how to use them:

Query: select t1.a, t2.b from t1 join t2 on t1.id = t2.id
Shards: 2
Sharding Key: id for both tables

Metrics Published:
1. QueryExecutions – {select, scatter, primary}, 1
2. QueryRoutes – {select, scatter, primary}, 2
3. QueryExecutionsByTable – {select, t1}, 1 and {select, t2}, 1

VTTablet

Name	Dimensions	Description	PR
TableRows	Table	Estimated number of rows in the table.	#17570
TableClusteredIndexSize	Table	Byte size of the clustered index (i.e. row data).	#17570
IndexCardinality	Table, Index	Estimated number of unique values in the index	#17570
IndexBytes	Table, Index	Byte size of the index.	#17570
UnresolvedTransaction	ManagerType	Number of events sent across all vstreams.	#16939
CommitPreparedFail	FailureType	Number of vstreams that ended with errors.	[#16939](https://github.com/vitessio/vit...

Vitess v21.0.3

Release of Vitess v21.0.3

The entire changelog for this release can be found here.

The release includes 13 merged Pull Requests.

Thanks to all our contributors: @GuptaManan100, @app/vitess-bot, @vitess-bot

Vitess v20.0.6

Release of Vitess v20.0.6

The entire changelog for this release can be found here.

The release includes 12 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @vitess-bot

Vitess v19.0.10

Release of Vitess v19.0.10

The entire changelog for this release can be found here.

The release includes 10 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @vitess-bot

Vitess v21.0.2

Release of Vitess v21.0.2

The entire changelog for this release can be found here.

The release includes 33 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @dbussink, @frouioui, @rohit-nayak-ps, @vitess-bot

Vitess v20.0.5

Release of Vitess v20.0.5

The entire changelog for this release can be found here.

The release includes 22 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @frouioui, @mattlord, @vitess-bot

Vitess v19.0.9

Release of Vitess v19.0.9

The entire changelog for this release can be found here.

The release includes 23 merged Pull Requests.

Thanks to all our contributors: @app/vitess-bot, @frouioui, @harshit-gangal, @mattlord, @rohit-nayak-ps, @vitess-bot