Skip to content

Use buffered file read for checksum calculation #1019

Open
@pbusko

Description

@pbusko

Proposed Change

As an operator
I want the executor to use buffered read of the files from UploadAction when it calculates sha256 and md5 sums
So that the complete files are not loaded in RAM, potentially consuming too much resources on a cell

Acceptance criteria

Scenario: a buildpack cache grows to several Gb and it has to be uploaded with the UploadAction
Given the standard configuration
When the executor tries to calculate sha256 and md5 sums of the file
Then it only loads small chunks at a time, preventing excessive resource usage

Related links

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Inbox

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions