0 Fork 0

mirror of https://github.com/FreshRSS/FreshRSS.git synced 2026-10-28 05:58:40 -04:00

Files

T

abp002andAlejandro Borrego 48547b4a6c Reduce memory consumption of export (#9350 )

Contributes to #6139 (export part; the import will follow in another PR)

Exporting favourites was collecting the whole file in memory. With many articles, it fails with the default PHP memory limit.

## Changes
- New `Minz_View::helperToFile()`, similar to `helperToString()`, writing the output of a helper into a file by chunks of 64 KiB instead of keeping it in memory.
- `FreshRSS_Export_Service`: the `generate*()` methods now return the path of a temporary file instead of the content, and `zip()` builds the archive from those files (`ZipArchive::addFile()` instead of `addFromString()`). Temporary files are created in `TMP_PATH` (already required to be writable) and deleted at the end of the script.
- The export is sent with `readfile()`: Web UI, `cli/export-zip-for-user.php`, `cli/export-opml-for-user.php` and the OPML export of the Google Reader API.
- Note: this changes what `FreshRSS_Export_Service` returns (a path instead of the content). All callers in the repository are updated, and I could not find any public extension using this service.

## Measurements
Peak PHP memory (`memory_get_peak_usage(true)`), SQLite database with synthetic starred articles:

| Scenario | Before | After |
|---|---|---|
| Web, export your favourites, 10,000 articles (69 MB JSON) | 136 MB (fails with the default `memory_limit` of 128 MB) | 6 MB |
| Web, ZIP (OPML + favourites + labelled articles + 4 feeds), 10,000 articles | 152 MB | 6 MB |
| CLI `export-zip-for-user.php`, 10,000 articles | 189 MB (fails with 128 MB) | 8 MB |
| Web, export your favourites, 30,000 articles (208 MB JSON) | 404 MB | 10 MB |

Co-authored-by: Alejandro Borrego <210245044+abp002@users.noreply.github.com>

2026-10-05 21:47:19 +02:00

app

Reduce memory consumption of export (#9350 )

2026-10-05 21:47:19 +02:00

cli

feat(cli): add reconfigure-user.php to read/write per-user config attributes (#8873 )

2026-05-24 13:25:04 +02:00

fixtures

Use strict_types (#5830 )

2023-11-16 22:43:00 +01:00

lib

Update to GT\CssXPath 1.6.0 (#9411 )

2026-10-05 21:44:57 +02:00

.gitignore

Mark as read 1 or 7 days based on publication date (#8163 )

2025-10-28 19:07:14 +01:00

.htaccess

Apache protect more non-public folders and files (#6881 )

2024-10-11 09:25:43 +02:00

bootstrap.php

Change how files are included (#7916 )

2025-09-05 15:56:46 +02:00

index.html

Apache protect more non-public folders and files (#6881 )

2024-10-11 09:25:43 +02:00

README.md

Upgrade to PHP 8.1 (#6711 )

2024-09-06 09:06:46 +02:00

shellchecks.sh

[CI] Run shellcheck and shfmt (#2454 )

2019-07-22 16:07:40 +02:00

README.md

FreshRSS tests

See our documentation about running tests.

make test-all

See test.yml for the GitHub Actions automated tests.

See composer.json for the different tests and versions, to be run locally.

Details about this tests folder

Unit tests are based on PHPUnit. Here is an example of manual install:

cd ./tests/
wget -O phpunit.phar https://phar.phpunit.de/phpunit-10.phar
php phpunit.phar --bootstrap bootstrap.php

The shellchecks.sh script is used to safeguard shell scripts from common shell script bugs and to ensure a consistent style. It requires ShellCheck and shfmt.