Magpie 2.3
Releases in the 2.3 series, newest first.
Magpie 2.3.25
Version 2.3.25 is a minor release in the 2.x series. It was released on13 Aug 2026 . Changes include:
- Ability to append to a file on cluster start
- Ability to use Authorization Code and Authorization Code with PKCE flows in the SSO flow
Magpie 2.3.24
Version 2.3.24 is a minor release in the 2.x series. It was released on16 Jul 2026 . Changes include:
- Bugfix for CLI not starting if in a directory containing spaces.
- Bugfix for extracting files from data sources.
- Bugfix for Python notebook text/html output.
Magpie 2.3.23
Version 2.3.23 is a minor release in the 2.x series. It was released on10 Jun 2026 . Changes include:
- Ability to add a finalizer task to jobs.
Magpie 2.3.22
Version 2.3.22 was skipped.
Magpie 2.3.21
Version 2.3.21 is a minor release in the 2.x series. It was released on13 May 2026 . Changes include:
- Update Spark to v3.5.8
- Add Developer permission to the repository object
Spark tickets worked since last upgrade
SPARK CORRECTNESS FIXES: 3.5.2 → 3.5.8
========================================
OUTPUT-AFFECTING CORRECTNESS FIXES
-----------------------------------
SPARK-54750 | ROUND returning NULL for Decimal values with low runtime precision
SPARK-52032 | ORC filter pushdown causes incorrect results with eqNullSafe (<=>) in DataFrame filter
SPARK-52023 | UDAF returning Option can cause data corruption and crashes
SPARK-51936 | ReplaceTableAsSelect should overwrite the new table instead of append
SPARK-51281 | DataFrameWriterV2 should respect the path option
SPARK-51831 | Column pruning with existsJoin for Datasource V2
SPARK-53738 | Fix planned write when query output contains foldable orderings
SPARK-54505 | Correct the arguments order of createMetrics call in makeNegative
SPARK-54625 | UTF8String#reverse should check offset and length on copying
SPARK-53598 | Check the existence of numParts before reading large table property
PLAN / PERFORMANCE CHANGES (may change side effects)
-----------------------------------------------------
SPARK-46485 | V1Write should not add Sort when not needed
⚠ If you relied on implicit in-partition ordering, add explicit sortWithinPartitions()
Magpie 2.3.20
Version 2.3.20 is a minor release in the 2.x series. It was released on22 Apr 2026 . Changes include:
- Added ability to upload files to Magpie and then assign those files to a cluster for either placement in the cluster file system or a pip install
- Added Cluster and Job Observability queries
- Made table/field descriptions persist across table rewrites
- Bugfix for case sensitive tables in a Snowflake schema
Magpie 2.3.19
Version 2.3.19 is a minor release in the 2.x series. It was released on23 Mar 2026 . Changes include:
- Table and field descriptions will now be persisted, if they exist, when a table is replaced
Magpie 2.3.18
Version 2.3.18 is a minor release in the 2.x series. It was released on11 Mar 2026 . Changes include:
- Added
allowConcurrentRunsflag to jobs that allows for disabling concurrent jobs when desired - Added ability to use repository in sql queries
Magpie 2.3.17
Version 2.3.17 is a minor release in the 2.x series. It was released on19 Feb 2026 . Changes include:
- Added python package list to Cluster metadata
- Updated Sql where clauses to now accept subqueries
- Added Access Token REST endpoints for managing service accounts
Magpie 2.3.16
Version 2.3.16 is a minor release in the 2.x series. It was released on23 Jan 2026 . This release contains no new Magpie features or bug fixes.
Magpie 2.3.15
Version 2.3.15 is a minor release in the 2.x series. It was released on Jan 21st, 2026. Changes include:
- Visualize permissions on a metadata object
- Send user an email if they try to login while account is disabled
- Add TimeZone field to job schedules
- Added new AssumedRoleCredential type for aws data sources
- Add TimeZone field to cluster schedules
Magpie 2.3.14
Version 2.3.14 is a minor release in the 2.x series. It was released on Nov 21st, 2025. Changes include:
- Added table size to table profiles
- Added ability to disable passwords
- Added endpoints for rotating access tokens
- Improved error messages on cluster health exceptions
- Improved performance of describe table command
- Bug fix for history logs
Magpie 2.3.13
Version 2.3.13 is a minor release in the 2.x series. It was released on Oct 3rd, 2025. This release contains new Magpie features or bug fixes.
Magpie 2.3.12
Version 2.3.12 is a minor release in the 2.x series. It was released on Oct 3rd, 2025. Changes include:
- Added job started notification trigger
- Added inherited permissions to permissions list on describe user commands
- Added a cluster start/stop/restart scheduler
- Bug fix for occasional duplicate magpie table being created
Magpie 2.3.11
Version 2.3.11 is a minor release in the 2.x series. It was released on Aug 20th, 2025. Changes include:
- Bug fix for Zeppelin
Magpie 2.3.10
Version 2.3.10 is a minor release in the 2.x series. It was released on Aug 9th, 2025. Changes include:
- Bug fix for Zeppelin code editor issues
Magpie 2.3.9
Version 2.3.9 is a minor release in the 2.x series. It was released on Aug 9th, 2025. Changes include:
- Upgraded BigQuery Spark connector
- Added support for BigQuery Create Table from Sql
- Added a target schema attribute to Sql Mapper Tasks
- Enhanced Job Schedule notifications to include a task list with task status
Magpie 2.3.8
Version 2.3.8 is a minor release in the 2.x series. It was released on July 25th, 2025. Changes include:
- Bug fix for Snowflake connector when using tables with case sensitive names
- Bug fix for Zeppelin browser memory leaks
Magpie 2.3.7
Version 2.3.7 is a minor release in the 2.x series. It was released on May 30th, 2025. Changes include:
- Magpie will now ignore file extensions when naming tables created using create schema from file based data sources
- Rooster will now fail queued jobs when shutting down
- Magpie will now mark running jobs and tasks as failed when the cluster that runs them is shutdown
- Magpie now has an export result from sql command
- Bug fix to address formatting for drop data source
- Bug fix to address password reset links being valid for deleted users
Magpie 2.3.6
Version 2.3.6 was skipped.
Magpie 2.3.5
Version 2.3.5 is a minor release in the 2.x series. It was released on April 11th, 2025. Changes include:
- Altered the describe schema command to include a description about the tables that reside within
- Added magpie commands for listing and deleting access tokens
- Updated Parquet dependency in Spark to v1.15.1 to mitigate recently discovered RCE vulnerability
Magpie 2.3.4
Version 2.3.4 is a minor release in the 2.x series. It was released on February 28th, 2025. Changes include:
- Updated Job Description window to move the long form description to the second tab leaving with Execution Graph as first
Magpie 2.3.3
Version 2.3.3 is a minor release in the 2.x series. It was released on January 31th, 2025. Changes include:
- Added SSO support for Microsoft Entra Identity Providers
- Updated Job Description window to remove long form description and replace with Execution Graph
Magpie 2.3.2
Version 2.3.2 is a minor release in the 2.x series. It was released on January 24th, 2025. Changes include:
- Bug fix to support displaying Private Keys in cluster description
Magpie 2.3.1
Version 2.3.1 is a minor release in the 2.x series. It was released on December 13th, 2024. Changes include:
- Add support for Private Keys to store SSH Keys and GCP Keys
- Upgrade Snowflake Spark Connector to version 2.16.0
- Enhancement to allow creating tables from database sources as writable
Magpie 2.3.0
Version 2.3.0 is a minor release in the 2.x series. It was released on October 22nd, 2024. There are no user-facing changes.