Brian Gough 893294e6b8 Merge pull request #24069 from overleaf/bg-backup-errors 1 년 전
..
api e145667a81 Merge pull request #23282 from overleaf/em-async-await-persist-changes 1 년 전
benchmarks 7f48c67512 Add `prefer-node-protocol` ESLint rule (#21532) 1 년 전
config a8030f9e32 Merge pull request #23970 from overleaf/bg-change-history-worker-to-use-queue-redis 1 년 전
migrations ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 년 전
storage 893294e6b8 Merge pull request #24069 from overleaf/bg-backup-errors 1 년 전
test 981e91f012 Merge pull request #21763 from overleaf/bg-backup-script 1 년 전
.gitignore ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 년 전
.mocharc.json ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 년 전
.nvmrc 272108a213 Run `bin/update_node 20.18.0 20.18.2` (#23074) 1 년 전
Dockerfile 272108a213 Run `bin/update_node 20.18.0 20.18.2` (#23074) 1 년 전
Makefile fe03d8d7fd Add shellcheck to web, server-pro, server-ce (#23823) 1 년 전
README.md ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 년 전
app.js 81aab1e159 [misc] fix logger.error(err) and logger.warn(err) calls (#23369) 1 년 전
backup-deletion-app.mjs 9cc6f2a9d5 Merge pull request #21829 from overleaf/jpa-backup-deletion 1 년 전
backup-verifier-app.mjs 3d7254b419 Merge pull request #22153 from overleaf/jpa-backup-verifier-minimal 1 년 전
backup-worker-app.mjs 763e5ba82c Merge pull request #23920 from overleaf/bg-backup-queue 1 년 전
buildscript.txt 32983da29c Merge pull request #23700 from overleaf/bg-history-redis 1 년 전
docker-compose.ci.yml 32983da29c Merge pull request #23700 from overleaf/bg-history-redis 1 년 전
docker-compose.yml 32983da29c Merge pull request #23700 from overleaf/bg-history-redis 1 년 전
install_deps.sh 9357f51fcf Merge pull request #22092 from overleaf/jpa-jq 1 년 전
knexfile.js ee85d948e2 Avoid duplicating a math-closing dollar sign (#11227) 3 년 전
package.json 767591973c Merge pull request #23905 from overleaf/ar-mocha-11 1 년 전
tsconfig.json 763e5ba82c Merge pull request #23920 from overleaf/bg-backup-queue 1 년 전

README.md

Database migrations

The history service uses knex to manage PostgreSQL migrations.

To create a new migrations, run:

npx knex migrate:make migration_name

To apply migrations, run:

npx knex migrate:latest

For more information, consult the knex migrations guide.

Global blobs

Global blobs are blobs that are shared between projects. The list of global blobs is stored in the projectHistoryGlobalBlobs Mongo collection and is read when the service starts. Changing the list of global blobs needs to be done carefully.

Adding a blob to the global blobs list

If we identify a blob that appears in many projects, we might want to move that blob to the global blobs list.

  1. Add a record for the blob to the projectHistoryGlobalBlobs collection.
  2. Restart the history service.
  3. Delete any corresponding project blobs.

Removing a blob from the global blobs list

Removing a blob from the global blobs list is trickier. As soon as the global blob is made unavailable, every project that needs the blob will have to get its own copy. To avoid disruptions, follow these steps:

  1. In the projectHistoryGlobalBlobs collection, set the demoted property to false on the global blob to remove. This will make the history system write new instances of this blob to project blobs, but still read from the global blob.

  2. Restart the history service.

  3. Copy the blob to all projects that need it.

  4. Remove the blob from the projectHistoryGlobalBlobs collection.

  5. Restart the history service.