Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature/#1858-add-s3-object-data-node #1868

Open
wants to merge 9 commits into
base: develop
Choose a base branch
from

Conversation

AdeshGhadage
Copy link

This pull request addresses issue #1858.

Hello Maintainers,

Could you please review my code? I would appreciate any suggestions or feedback you might have.

Thank you!

@jrobinAV jrobinAV self-assigned this Oct 1, 2024
@jrobinAV jrobinAV added hacktoberfest hacktoberfest issues hacktoberfest - 100💎 Issues rewarded by 100 points labels Oct 1, 2024
@trgiangdo trgiangdo linked an issue Oct 1, 2024 that may be closed by this pull request
4 tasks
Copy link
Member

@trgiangdo trgiangdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @AdeshGhadage, thank you for your contribution.

The PR has well-handled the __AWS_REGION parameter.

And for the __AWS_S3_OBJECT_PARAMETERS, it is more complex since we need a more generic solution, which requires updating the configuration as well.

Please take a look at my comment and let me know what you think.

taipy/core/data/aws_s3.py Outdated Show resolved Hide resolved
taipy/core/data/aws_s3.py Outdated Show resolved Hide resolved
@jrobinAV jrobinAV assigned trgiangdo and unassigned jrobinAV Oct 1, 2024
Copy link
Member

@trgiangdo trgiangdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good progress.

The next step would be:

  • updating the configuration for the S3ObjectDataNode here
  • updating the docstring for the _configure_s3_object() method with new parameters.
  • updating the docstring of the S3ObjectDataNode class. It should be very similar to the _configure_s3_object() method.

taipy/core/data/aws_s3.py Outdated Show resolved Hide resolved
@AdeshGhadage
Copy link
Author

@trgiangdo @jrobinAV Any other changes ? or some mistake I have made?

Copy link
Member

@trgiangdo trgiangdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some final comments. Other than those, I think the PR is looking really good

taipy/core/config/data_node_config.py Outdated Show resolved Hide resolved
taipy/core/config/data_node_config.py Outdated Show resolved Hide resolved
Copy link
Member

@trgiangdo trgiangdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You also need to remove the _OPTIONAL_AWS_S3_OBJECT_PARAMETERS_PROPERTY in line 263 of the data_node_config.py file, and add the new OPTIONAL.. constant to the _STORAGE_TYPE_VALUE_S3_OBJECT dict (as pointed out by the linter)

@trgiangdo
Copy link
Member

There are still some trailing spaces left in the code, as suggested by the linter here.

Other than that, I believe the PR is good to go, when all tests pass

Copy link
Member

@trgiangdo trgiangdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @AdeshGhadage, thank you again for your contribution. The PR is ready to be merged.

However, due to the fact that Taipy is in the middle of a release, we will have to freeze all code changes for a few days.

In the meantime, feel free to take another issue to work on. We will merge this PR when the release is completed.

@jrobinAV jrobinAV added the hacktoberfest: approved to label a PR approved for hacktoberfest rewards label Oct 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hacktoberfest - 100💎 Issues rewarded by 100 points hacktoberfest: approved to label a PR approved for hacktoberfest rewards hacktoberfest hacktoberfest issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow S3ObjectDatanodes to use all parameters exposed by AWS APIs
3 participants