Skip to content
This repository has been archived by the owner on Nov 14, 2022. It is now read-only.

Support vanilla spark 3.1.1 #33

Open
wants to merge 35 commits into
base: master
Choose a base branch
from

Conversation

JustDoCoder
Copy link
Contributor

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

@github-actions
Copy link

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/pmem-spill/issues

Then could you also rename commit message and pull request title in the following format?

[PMEM-SPILL-${ISSUES_ID}] ${detailed message}

See also:

@JustDoCoder JustDoCoder changed the title Support apache 3.1.1 Support Apache Spark 3.1.1 Apr 16, 2021
@JustDoCoder JustDoCoder changed the title Support Apache Spark 3.1.1 Support vanilla spark 3.1.1 Apr 19, 2021
@yeyuqiang
Copy link
Contributor

LGTM. @winningsix @yma11 most code change involved with execution memory. Please also take a review

@@ -97,6 +97,11 @@ public int getNumRecords() {
return numRecords;
}

@Override
public long getCurrentPageNumber() {
throw new UnsupportedOperationException();

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yma11 will this work?

@winningsix
Copy link

@yma11 can you add a JIRA ID on this?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants