Skip to content

[feat req] xz/7z support for compression for slow connections on Self-Hosted Runner #794

@devizer

Description

@devizer

What would you like to be added?

In Addition to the first reason from the title:

  1. Slow connections on Self-Hosted Runner

Another reason is:
2) Slow connection in some regions. Even with a gigabit connection, the routing speed to GitHub Actions artifacts is only 1–2 Mbps.

for xz compression there is proven soltion equals to 7z -ms=on -mqs=on options to singificantly reduce archive size: Get-Files-In-Optimal-Order-For-Solid-Archive. I'm using this for maximum xz-compression, utilizing all the CPU cores:

Get-Files-In-Optimal-Order-For-Solid-Archive "$folder" | tar -c -f - --no-recursion -T - | 7z a dummy -txz -mmt=$(nproc) -mx=$COMPRESSION_LEVEL -si -so > /path-to-xz-archive.tar.xz

source: https://devizer.github.io/DevOps-Library.sh, depends on pure perl 5.8+ without perl libraries.

Why is this needed?

In Addition to the first reason from the title: 1) Slow connections on Self-Hosted Runner
Another reason is 2) Slow connection in some regions. Even with a gigabit connection, the routing speed to GitHub Actions artifacts is only 1–2 Mbps.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions