1
0
Fork 0
mirror of https://github.com/immich-app/immich.git synced 2025-03-01 15:11:21 +01:00
immich/server/src
Mert 64636c0618
feat(server): near-duplicate detection (#8228)
* duplicate detection job, entity, config

* queueing

* job panel, update api

* use embedding in db instead of fetching

* disable concurrency

* only queue visible assets

* handle multiple duplicateIds

* update concurrent queue check

* add provider

* add web placeholder, server endpoint, migration, various fixes

* update sql

* select embedding by default

* rename variable

* simplify

* remove separate entity, handle re-running with different threshold, set default back to 0.02

* fix tests

* add tests

* add index to entity

* formatting

* update asset mock

* fix `upsertJobStatus` signature

* update sql

* formatting

* default to 0.03

* optimize clustering

* use asset's `duplicateId` if present

* update sql

* update tests

* expose admin setting

* refactor

* formatting

* skip if ml is disabled

* debug trash e2e

* remove from web

* remove from sidebar

* test if ml is disabled

* update sql

* separate duplicate detection from clip in config, disable by default for now

* fix doc

* lower minimum `maxDistance`

* update api

* Add and Use Duplicate Detection Feature Flag (#9364)

* Add Duplicate Detection Flag

* Use Duplicate Detection Flag

* Attempt Fixes for Failing Checks

* lower minimum `maxDistance`

* fix tests

---------

Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>

* chore: fixes and additions after rebase

* chore: update api (remove new Role enum)

* fix: left join smart search so getAll works without machine learning

* test: trash e2e go back to checking length of assets is zero

* chore: regen api after rebase

* test: fix tests after rebase

* redundant join

---------

Co-authored-by: Nicholas Flamy <30300649+NicholasFlamy@users.noreply.github.com>
Co-authored-by: Zack Pollard <zackpollard@ymail.com>
Co-authored-by: Zack Pollard <zack@futo.org>
2024-05-16 18:08:37 +01:00
..
commands refactor(server): immich-admin list-users (#8862) 2024-04-17 12:27:04 +00:00
controllers feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
cores refactor(server): system config (#9517) 2024-05-15 18:58:23 -04:00
dtos feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
emails chore(server): email notification button png (#9423) 2024-05-13 15:36:35 +00:00
entities feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
interfaces feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
middleware refactor(server): auth route metadata (#9344) 2024-05-09 13:58:44 -04:00
migrations feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
queries feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
repositories feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
services feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
subscribers chore: migrate database files (#8126) 2024-03-20 21:02:51 +00:00
utils feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
workers feat(server): run microservices in worker thread (#9426) 2024-05-14 15:28:20 +01:00
app.module.ts feat(server): logging interceptor (#8859) 2024-04-16 19:21:57 -04:00
config.ts feat(server): near-duplicate detection (#8228) 2024-05-16 18:08:37 +01:00
constants.ts chore: lifecycle metadata (#9103) 2024-04-29 13:48:28 +00:00
database.config.ts chore(server): default postgres hostname to compose service name (#9118) 2024-04-27 13:43:45 -04:00
decorators.ts feat(server): read-write external assets (#9235) 2024-05-03 15:34:57 -04:00
main.ts refactor(server): system config (#9484) 2024-05-14 14:43:49 -04:00
validation.ts chore: organize config, validation, decorators (#8118) 2024-03-20 16:04:03 -04:00