Brian Gough ff267ca246 Merge pull request #28640 from overleaf/bg-fix-chunk-store-metrics 1 жил өмнө
..
api 6c6048002b Merge pull request #28595 from overleaf/revert-28594-revert-28533-mj-blob-ranges-maxsize 1 жил өмнө
backupVerifier 99ab41fd76 Allow scaling in getEndDateForRPO 1 жил өмнө
benchmarks 7f48c67512 Add `prefer-node-protocol` ESLint rule (#21532) 2 жил өмнө
config f68bf5a69f Merge pull request #26477 from overleaf/em-redis-buffer-resync 1 жил өмнө
migrations 2256697323 Merge pull request #24967 from overleaf/em-chunks-concurrency-pg-migration 1 жил өмнө
storage ff267ca246 Merge pull request #28640 from overleaf/bg-fix-chunk-store-metrics 1 жил өмнө
test 6c6048002b Merge pull request #28595 from overleaf/revert-28594-revert-28533-mj-blob-ranges-maxsize 1 жил өмнө
.mocharc.json ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 жил өмнө
.nvmrc 6190005f9b [monorepo] Upgrade to node 22.18.0 (#27977) 1 жил өмнө
Dockerfile 6190005f9b [monorepo] Upgrade to node 22.18.0 (#27977) 1 жил өмнө
Makefile 8f0913fafe Merge pull request #27936 from overleaf/em-unit-tests-mongo 1 жил өмнө
README.md ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 жил өмнө
app.js eb2320a8af Merge pull request #27823 from overleaf/em-increase-max-request-size 1 жил өмнө
backup-deletion-app.mjs 9cc6f2a9d5 Merge pull request #21829 from overleaf/jpa-backup-deletion 2 жил өмнө
backup-verifier-app.mjs cde7ff5d2f Don't run the verifier loop when app created from test 1 жил өмнө
backup-worker-app.mjs efd53e567c Merge pull request #24237 from overleaf/bg-fix-backup-worker 1 жил өмнө
buildscript.txt 423c2a47e5 Merge pull request #28482 from overleaf/ar-move-notifications-changes-into-buildscripts 1 жил өмнө
docker-compose.ci.yml 8948e40b22 Revert "Merge pull request #27679 from overleaf/msm-aws-sdk-upgrade" (#28151) 1 жил өмнө
docker-compose.yml 8948e40b22 Revert "Merge pull request #27679 from overleaf/msm-aws-sdk-upgrade" (#28151) 1 жил өмнө
install_deps.sh 9357f51fcf Merge pull request #22092 from overleaf/jpa-jq 2 жил өмнө
knexfile.js ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 жил өмнө
package.json a6e9a5c7e9 [monorepo] run prettier on Jenkinsfiles (#28565) 1 жил өмнө
tsconfig.json f6bd485863 [misc] align initializing of mongodb replica set (#24287) 1 жил өмнө

README.md

Database migrations

The history service uses knex to manage PostgreSQL migrations.

To create a new migrations, run:

npx knex migrate:make migration_name

To apply migrations, run:

npx knex migrate:latest

For more information, consult the knex migrations guide.

Global blobs

Global blobs are blobs that are shared between projects. The list of global blobs is stored in the projectHistoryGlobalBlobs Mongo collection and is read when the service starts. Changing the list of global blobs needs to be done carefully.

Adding a blob to the global blobs list

If we identify a blob that appears in many projects, we might want to move that blob to the global blobs list.

  1. Add a record for the blob to the projectHistoryGlobalBlobs collection.
  2. Restart the history service.
  3. Delete any corresponding project blobs.

Removing a blob from the global blobs list

Removing a blob from the global blobs list is trickier. As soon as the global blob is made unavailable, every project that needs the blob will have to get its own copy. To avoid disruptions, follow these steps:

  1. In the projectHistoryGlobalBlobs collection, set the demoted property to false on the global blob to remove. This will make the history system write new instances of this blob to project blobs, but still read from the global blob.

  2. Restart the history service.

  3. Copy the blob to all projects that need it.

  4. Remove the blob from the projectHistoryGlobalBlobs collection.

  5. Restart the history service.