You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
After create a pyspark pipeline with the combined data record, split the data record, the project can't be built because the under the -shared module directory, the -core-python module still depends on the pyspark dependency for the pysaprk.sqlRow import
Steps to Reproduce
Navigate to the regression test script.
Follow the steps for Getting Started, Instantiating the Regression Test Project, and Adding Pipelines, Record, and Dictionary Models
After build complete and no more manual actions are required, follow the instruction to split data record
After correct dependency on the pyspark pipeline pyproject.toml and pom.xm file, you will encounter below error with the build following:
Description
After create a pyspark pipeline with the combined data record, split the data record, the project can't be built because the under the
-shared
module directory, the-core-python
module still depends on thepyspark
dependency for thepysaprk.sql
Row
importSteps to Reproduce
pyspark
pipelinepyproject.toml
andpom.xm
file, you will encounter below error with the build following:Expected Behavior
The build should pass without adding the pyspark dependency in the pyproject.toml file.
Actual Behavior
The build fails.
Additional Context
The text was updated successfully, but these errors were encountered: