
- #Winutils.exe download spark update
- #Winutils.exe download spark upgrade
- #Winutils.exe download spark full
: Metadata output should not always be propagated. : conv() does not convert negative inputs to unsigned correctly. : Support reconcile schemas based on index after nested column pruning. : Non-nullable aggregates can return NULL in a correlated subquery. : computeAllMetrics may return partial metrics when some child metrics are missing. : Fix cases of corruption in merged shuffle blocks that are pushed. : There is a potential Netty memory leak in TransportResponseHandler. : Apply right-padding correctly for correlated subqueries. : LikeSimplification should handle NULL. : Pass the raised ImportError if pandas or pyarrow fail to import. : Codegen compilation error for query with LIMIT operator and without AQE. : Nested higher-order functions broken in DSL. : Fail in fetch shuffle blocks in batch when i/o encryption is enabled. : Catalyst error on on certain struct operation (Couldn’t find gen_alias). : RebaseDateTime loadRebaseRecords should use Spark classloader instead of context. : InMemor圜atalog.tableExists should not fail if database doesn’t exist. : Respect the default input buffer size in Univocity. : Do not capture maven config for views. : col(), $” " and df("name") should handle quoted column names properly. : Discrepancy between TIMESTAMP_SECONDS and cast from float. : ConcurrentModificationException in EventLoggingListener when redacting properties. : Difference in results of casting float to timestamp. : Fix Interpreted evaluation by using getClass.getMethod instead of getDeclaredMethod. : Correct parameter type for subexpression elimination under whole-stage. : Fail if the view query has duplicated column names. : collect_list(struct()) fails when used with GROUP BY. : Group by CreateStruct with ExtractValue fails analysis. : Allow DESCRIBE FUNCTION and SHOW FUNCTIONS explain about string concatenation operator. : Regression in “operating on canonicalized plan” check in CustomShuffleReaderExec. #Winutils.exe download spark full
: Full outer shuffled hash join when building left side produces wrong result. : Spark app on k8s doesn’t terminate without call to sparkContext.stop() method. : Always remove unnecessary Alias in Analyzer.resolveExpression. : Fix view does not capture disable hint config. : Fix Python UDF used in GroupedAggPandasUDFTests. : NewInstance.resolved should not throw malformed class name error. : INSERT INTO OVERWRITE doesn’t support partition columns containing dot for DSv2. : NewInstance.doGenCode should not throw malformed class name error. : When insert into a partition table with a illegal partition value, DSV2 behavior different as others. : Cannot drop/add columns from/to a dataset of v2 DESCRIBE NAMESPACE. #Winutils.exe download spark update
: CreateTableAsSelect should have metrics update too.
: Cannot drop/add columns from/to a dataset of v2 DESCRIBE TABLE.: Checking duplicate static partition columns doesn’t respect case sensitive conf.: Resolve metadata output from DataFrame.: Skip InSet null value during push filter to Hive metastore.: Resolve using child metadata attributes as fallback.
: Fix inconsistent results when applying 2 Python UDFs with different return type to 2 columns together.: Respect case sensitivity in V1 ALTER TABLE.
: New protocol FetchShuffleBlocks in OneForOneBlockFetcher lead to data loss or correctness.: Fix NPE if InSet contains null value during getPartitionsByFilter.: Avoid unnecessary view resolving and remove the performCheck flag.: JDBC connection provider is not removing kerberos credentials from JVM security context.: Table maybe resolved as a view if the table is dropped.: Correct the active SparkSession for streaming query.: Avoid NPE in DataFrameReader.schema(StructType).
: DataFrameNaFunctions.fillMap(values: Seq) fails for column name having a dot. : Invalid ID for offset-based ZoneId since Spark 3.0. : Dynamic allocation on K8s kills executors with running tasks. : V2 Datasources that extend FileScan preclude exchange reuse. #Winutils.exe download spark upgrade
We strongly recommend all 3.1 users to upgrade to this stable release. This release is based on the branch-3.1 maintenance branch of Spark. Spark 3.1.2 is a maintenance release containing stability fixes.