SipsOfCode/infrastructure
2
2
Fork 0
Code Issues 5 Pull requests 4 Releases Activity

feat(forgejo): Expire repository archives faster #7

Merged
histalek merged 1 commit from expire-archives-faster into main 2025-02-02 14:25:50 +01:00
Conversation 3 Commits 1 Files changed 1 +6
histalek commented 2025-02-02 09:04:45 +01:00
Owner
Copy link

This is needed to limit the amount of data on our forgejo host.

Currently our repositories take up ~2GB of storage while the repository
archives take up ~29GB.
This most likely happens because of scraper bots [1].

With this change we now expire repo archives older than 2 hours and
clean those up every hour. This should keep the disk space used at least
somewhat limited. Config ref [2]

In addition to this we might want to deploy a proper robots.txt [3] to
at least keep good bots out.

[1] https://codeberg.org/forgejo/forgejo/issues/923
[2] https://forgejo.org/docs/latest/admin/config-cheat-sheet/#cron---cleanup-old-repository-archives-cronarchive_cleanup
[3] https://code.forgejo.org/robots.txt

This is needed to limit the amount of data on our forgejo host. Currently our repositories take up ~2GB of storage while the repository archives take up ~29GB. This most likely happens because of scraper bots [1]. With this change we now expire repo archives older than 2 hours and clean those up every hour. This should keep the disk space used at least somewhat limited. Config ref [2] In addition to this we might want to deploy a proper robots.txt [3] to at least keep good bots out. [1] https://codeberg.org/forgejo/forgejo/issues/923 [2] https://forgejo.org/docs/latest/admin/config-cheat-sheet/#cron---cleanup-old-repository-archives-cronarchive_cleanup [3] https://code.forgejo.org/robots.txt
feat(forgejo): Expire repository archives faster
All checks were successful
ci/woodpecker/pr/ansible-lint Pipeline was successful
Details
ci/woodpecker/push/ansible-lint Pipeline was successful
Details
d13591d215
 
This is needed to limit the amount of data on our forgejo host.

Currently our repositories take up ~2GB of storage while the repository
archives take up ~29GB.
This most likely happens because of scraper bots [1].

With this change we now expire repo archives older than 2 hours and
clean those up every hour. This should keep the disk space used at least
somewhat limited. Config ref [2]

In addition to this we might want to deploy a proper robots.txt [3] to
at least keep good bots out.

[1] https://codeberg.org/forgejo/forgejo/issues/923
[2] https://forgejo.org/docs/latest/admin/config-cheat-sheet/#cron---cleanup-old-repository-archives-cronarchive_cleanup
[3] https://code.forgejo.org/robots.txt
requested review from saibotk 2025-02-02 09:04:54 +01:00
saibotk approved these changes 2025-02-02 14:22:11 +01:00
saibotk left a comment
Owner
Copy link

LGTM.

For the robots.txt i created another issue #8

LGTM. For the robots.txt i created another issue #8
❤️ 1
histalek deleted branch expire-archives-faster 2025-02-02 14:25:50 +01:00
histalek commented 2025-02-02 14:30:45 +01:00
Author
Owner
Copy link

deployed and LOL
image

deployed and LOL ![image](/attachments/85af18c8-b1f1-4b83-95d6-d4921120500f)
image.png
36 KiB
saibotk commented 2025-02-02 14:33:38 +01:00
Owner
Copy link

Wild West Web 😆

Wild West Web 😆
Sign in to join this conversation.
Reviewers
No reviewers
saibotk
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
histalek
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: SipsOfCode/infrastructure#7
No description provided.
Delete branch "expire-archives-faster"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?