renovate[bot]
eea0a98090
chore(deps): update machine-learning ( #7890 )
2024-03-15 17:19:28 -04:00
Andrew Rowson
37e5b91dc2
fix(server): ml gunicorn listen on ipv4 and ipv6 by default ( #7930 )
2024-03-13 12:13:56 -05:00
renovate[bot]
4b4ebe4f80
fix(deps): update machine-learning ( #7871 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-03-11 23:26:43 -04:00
Alex The Bot
4027cba4eb
Version v1.98.2
2024-03-11 14:17:12 +00:00
Alex The Bot
430561d692
Version v1.98.1
2024-03-08 23:44:13 +00:00
Sam Holton
dbb6a8dc2a
fix(server): remove shared links during user delete ( #7696 )
...
* fix(server): remove shared links during user delete
* add delete cascade for shared links
2024-03-07 17:21:23 -05:00
Alex The Bot
7dc5e0cc4f
Version v1.98.0
2024-03-07 19:22:14 +00:00
Alex Tran
ba5d5256b1
Revert "Version v1.98.0"
...
This reverts commit 9b1a379fa6
2024-03-07 12:04:54 -06:00
Alex The Bot
9b1a379fa6
Version v1.98.0
2024-03-07 17:40:40 +00:00
renovate[bot]
4c0bb2308c
fix(deps): update machine-learning ( #7634 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-03-06 00:24:33 -05:00
DawidPietrykowski
e8b001f62f
feat: preloading of machine learning models ( #7540 )
2024-03-03 19:48:56 -05:00
martin
8ce18b3403
feat(machine-learning): support cuda 12 ( #7569 )
...
* feat: support cuda12
* fix: group optional
* move to cuda 12
* pr feedback
2024-03-02 23:36:16 -05:00
Alex The Bot
6f53e83d49
Version v1.97.0
2024-02-28 22:34:00 +00:00
Alex The Bot
6d91c23f65
Version v1.96.0
2024-02-27 20:14:58 +00:00
renovate[bot]
fd301a3261
fix(deps): update dependency orjson to v3.9.15 [security] ( #7438 )
2024-02-27 10:59:28 -05:00
renovate[bot]
8965c25f54
chore(deps): update machine-learning ( #7451 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-27 00:53:37 -05:00
Mert
7e18e69c1c
fix(ml): only use openvino if a gpu is available ( #7450 )
...
use `device_type`
2024-02-27 00:45:14 -05:00
Sourav Agrawal
2a75f884d9
Fix Smart Search when using OpenVINO ( #7389 )
...
* Fix external_path loading in OpenVINO EP
* Fix ruff lint
* Wrap block in try finally
* remove static input shape code
* add unit test
* remove unused imports
* remove repeat line
* linting
* formatting
---------
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-02-24 18:22:27 -05:00
renovate[bot]
a771f33fa3
chore(deps): update machine-learning ( #7225 )
2024-02-21 01:12:38 -05:00
Alex The Bot
7c34d0595e
Version v1.95.1
2024-02-21 04:02:43 +00:00
Alex The Bot
302d98ebe1
Version v1.95.0
2024-02-20 16:52:23 +00:00
martin
ddae707ea9
fix: shell scripts ( #7186 )
...
* fix: bash scripts
* pr feedback
* wrong variable
* ci: add shellcheck workflow
* fix: missing scripts
2024-02-18 17:03:01 -06:00
renovate[bot]
3cfe2dd31f
chore(deps): update machine-learning ( #7084 )
2024-02-13 16:04:40 +00:00
renovate[bot]
a0159251d9
chore(deps): update machine-learning ( #7074 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-13 09:02:32 -05:00
renovate[bot]
2b8ec30767
chore(deps): update machine-learning (major) ( #6934 )
...
* chore(deps): update machine-learning
* formatting
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-02-12 22:29:15 -05:00
renovate[bot]
bfba81de94
chore(deps): update machine-learning ( #6931 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-12 21:08:17 -05:00
renovate[bot]
a8fefe4467
fix(deps): update dependency python-multipart to v0.0.7 [security] ( #7054 )
2024-02-12 13:32:12 -05:00
Fynn Petersen-Frey
49c378d706
fix(ml): re-enable ARMNN integration ( #7053 )
2024-02-12 13:29:55 -05:00
Mert
0c4df216d7
feat(ml): improve test coverage ( #7041 )
...
* update e2e
* tokenizer tests
* more tests, remove unnecessary code
* fix e2e setting
* add tests for loading model
* update workflow
* fixed test
2024-02-11 17:58:56 -05:00
Mert
c9b7f4e690
chore(ml): make execution provider log info-level ( #7024 )
...
* change debug log to info
* update test
2024-02-11 06:12:11 +00:00
renovate[bot]
f7d0a8ed0a
fix(deps): update dependency fastapi to v0.109.1 [security] ( #6923 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-02-06 12:21:24 +01:00
Mert
79d3342c3d
fix(ml): openvino not working with dynamic axes ( #6871 )
...
* convert to static
* add comment about gross code
* formatting
* fixed test
* fix typing
* cleanup
* formatting
* Revert "formatting"
This reverts commit 073965c47ebb56bd3297
2024-02-03 05:35:26 +00:00
Alex The Bot
07466fa7b7
Version v1.94.1
2024-01-31 19:21:00 +00:00
Alex The Bot
a7ed2b7132
Version v1.94.0
2024-01-31 15:41:53 +00:00
renovate[bot]
2bcba526df
fix(deps): update machine-learning ( #6745 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-29 20:43:14 -05:00
Mert
f52994e8ca
fix(ml): model paths not working ( #6705 )
...
* fix str enum string repr
* fixed typing
2024-01-28 20:54:33 +00:00
Mert
a84b6f5fb1
feat(ml): conditionally download .armnn models ( #6650 )
2024-01-28 10:31:59 -05:00
Mert
2249f7d42a
fix(ml): handle missing context_length field ( #6695 )
...
* handle missing `context_length` field
* specify list type
2024-01-27 19:50:50 -05:00
Mert
ca28e1e7a8
fix(ml): error logging ( #6646 )
...
* fix ml error logging
* exclude certain libraries from traceback
2024-01-26 00:26:27 +00:00
renovate[bot]
1c35110806
fix(deps): update dependency orjson to v3.9.12 ( #6600 )
2024-01-23 18:10:10 -05:00
renovate[bot]
871d0c725f
chore(deps): pin dependencies ( #6436 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-22 11:08:00 -05:00
Mert
95cfe22866
feat(ml)!: cuda and openvino acceleration ( #5619 )
...
* cuda and openvino ep, refactor, update dockerfile
* updated workflow
* typing fixes
* added tests
* updated ml test gh action
* updated README
* updated docker-compose
* added compute to hwaccel.yml
* updated gh matrix
updated gh matrix
updated gh matrix
updated gh matrix
updated gh matrix
give up
* remove cuda/arm64 build
* add hwaccel image tags to docker-compose
* remove unnecessary quotes
* add suffix to git tag
* fixed kwargs in base model
* armnn ld_library_path
* update pyproject.toml
* add armnn workflow
* formatting
* consolidate hwaccel files, update docker compose
* update hw transcoding docs
* add ml hwaccel docs
* update dev and prod docker-compose
* added armnn prerequisite docs
* support 3.10
* updated docker-compose comments
* formatting
* test coverage
* don't set arena extend strategy for openvino
* working openvino
* formatting
* fix dockerfile
* added type annotation
* add wsl configuration for openvino
* updated lock file
* copy python3
* comment out extends section
* fix platforms
* simplify workflow suffix tagging
* simplify aio transcoding doc
* update docs and workflow for `hwaccel.yml` change
* revert docs
2024-01-21 18:22:39 -05:00
Alex The Bot
4ebb9974ff
Version v1.93.3
2024-01-20 16:03:18 +00:00
Alex The Bot
3dddc6b449
Version v1.93.2
2024-01-19 18:29:04 +00:00
Alex The Bot
d5af357992
Version v1.93.1
2024-01-19 15:01:17 +00:00
Alex The Bot
fa0b7c8563
Version v1.93.0
2024-01-19 02:14:46 +00:00
Mert
68f52818ae
feat(server): separate face clustering job ( #5598 )
...
* separate facial clustering job
* update api
* fixed some tests
* invert clustering
* hdbscan
* update api
* remove commented code
* wip dbscan
* cleanup
removed cluster endpoint
remove commented code
* fixes
updated tests
minor fixes and formatting
fixed queuing
refinements
* scale search range based on library size
* defer non-core faces
* optimizations
removed unused query option
* assign faces individually for correctness
fixed unit tests
remove unused method
* don't select face embedding
update sql
linting
fixed ml typing
* updated job mock
* paginate people query
* select face embeddings because typeorm
* fix setting face detection concurrency
* update sql
formatting
linting
* simplify logic
remove unused imports
* more specific delete signature
* more accurate typing for face stubs
* add migration
formatting
* chore: better typing
* don't select embedding by default
remove unused import
* updated sql
* use normal try/catch
* stricter concurrency typing and enforcement
* update api
* update job concurrency panel to show disabled queues
formatting
* check jobId in queueAll
fix tests
* remove outdated comment
* better facial recognition icon
* wording
wording
formatting
* fixed tests
* fix
* formatting & sql
* try to fix sql check
* more detailed description
* update sql
* formatting
* wording
* update `minFaces` description
---------
Co-authored-by: Jason Rasmussen <jrasm91@gmail.com>
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2024-01-18 00:08:48 -05:00
renovate[bot]
d3ff2408bc
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to 377aafa ( #6434 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2024-01-16 16:39:31 -05:00
Mert
e2666f0e74
fix(ml): remove unused import ( #6356 )
...
* remove unused import
* formatting
2024-01-13 00:25:26 -05:00
renovate[bot]
20be42cec0
chore(deps): update machine-learning ( #6302 )
...
* chore(deps): update machine-learning
* fix typing, use new lifespan syntax
* wrap in try / finally
* move log
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-01-13 05:00:09 +00:00
Fynn Petersen-Frey
753292956e
feat(ml): ARMNN acceleration ( #5667 )
...
* feat(ml): ARMNN acceleration for CLIP
* wrap ANN as ONNX-Session
* strict typing
* normalize ARMNN CLIP embedding
* mutex to handle concurrent execution
* make inputs contiguous
* fine-grained locking; concurrent network execution
---------
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2024-01-11 18:26:46 +01:00
Alex The Bot
df59b2099f
Version v1.92.1
2024-01-08 15:24:38 +00:00
Alex The Bot
319ddfda53
Version v1.92.0
2024-01-08 05:19:11 +00:00
renovate[bot]
3edc87f684
fix(deps): update machine-learning ( #5180 )
...
* fix(deps): update machine-learning
* updated ruff command
* use isinstance
---------
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2023-12-25 22:37:48 -05:00
renovate[bot]
612590feda
fix(deps): update dependency pillow to v10 [security] ( #5944 )
2023-12-23 14:10:05 +00:00
Mert
19ea0ead85
renovate: use in-range-only strategy for python ( #5937 )
2023-12-23 09:04:36 -05:00
Mert
4dd7412a86
pin python ( #5904 )
2023-12-21 11:54:56 -05:00
Mert
092a23fd7f
feat(server,ml): remove image tagging ( #5903 )
...
* remove image tagging
* updated lock
* fixed tests, improved logging
* be nice
* fixed tests
2023-12-20 20:47:56 -05:00
Alex The Bot
b40859551b
Version v1.91.4
2023-12-19 03:34:19 +00:00
Alex The Bot
08f66c2ae5
Version v1.91.3
2023-12-17 16:57:16 +00:00
Mert
09402eb6d0
fix(ml): disable core dumps ( #5770 )
...
* update dockerfile
* remove sysctl line
2023-12-16 20:30:29 -06:00
Alex The Bot
a15c799ba3
Version v1.91.2
2023-12-16 23:19:58 +00:00
Alex The Bot
0aae9696f6
Version v1.91.1
2023-12-16 17:26:51 +00:00
Mohamed BOUSSAID
7839be3b49
Adding the new models to the whitelist ( #5736 )
2023-12-15 22:45:14 +00:00
Alex The Bot
e9a8daa924
Version v1.91.0
2023-12-15 15:22:37 +00:00
renovate[bot]
e05c7f5b76
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to 5ea70d2 ( #5707 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-14 23:09:48 -05:00
Mert
d729c863c8
chore(ml): improve shutdown ( #5689 )
2023-12-14 13:51:24 -06:00
renovate[bot]
d2ad01cd2f
chore(deps): update python:3.11-slim-bookworm docker digest to cfd7ed5 ( #5572 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-09 21:15:15 -06:00
Alex The Bot
429ad28810
Version v1.90.2
2023-12-08 14:23:04 +00:00
Alex The Bot
d2fbbe790b
Version v1.90.1
2023-12-08 04:20:27 +00:00
Alex The Bot
c174f0e871
Version v1.90.0
2023-12-07 18:32:45 +00:00
renovate[bot]
259700c45f
chore(deps): update mambaorg/micromamba:bookworm-slim docker digest to e296d47 ( #5487 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-04 19:37:08 -05:00
renovate[bot]
56aed8246d
chore(deps): update python:3.11-slim-bookworm docker digest to cc75851 ( #5462 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-04 13:26:41 -06:00
renovate[bot]
6959cf689b
chore(deps): update python:3.11-bookworm docker digest to ba7a7ac ( #5438 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-02 18:35:23 +00:00
renovate[bot]
cbdcbd3ab4
chore(deps): update python:3.11-slim-bookworm docker digest to 8f82989 ( #5435 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 20:24:50 +00:00
renovate[bot]
cb00d45e3d
chore(deps): update python:3.11-bookworm docker digest to 47c1829 ( #5434 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 20:13:23 +00:00
renovate[bot]
40964187bb
chore(deps): update python:3.11-slim-bookworm docker digest to 23f5220 ( #5388 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 18:36:54 +00:00
renovate[bot]
fe3d951f26
chore(deps): update python:3.11-bookworm docker digest to c56b0c6 ( #5387 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-12-01 18:36:30 +00:00
Alex The Bot
8b6a79ad9e
Version v1.89.0
2023-11-29 19:20:24 +00:00
renovate[bot]
1fa5e220a1
chore(deps): pin dependencies ( #5367 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-11-29 02:09:11 +00:00
Mert
6e10d15f2c
pin python ( #5272 )
2023-11-22 19:42:17 -05:00
Alex The Bot
55fa3234fd
Version v1.88.2
2023-11-21 16:09:18 +00:00
Alex Tran
a13052e24c
Revert "Version v1.88.2"
...
This reverts commit bc2c73e499
2023-11-21 09:07:50 -06:00
Alex The Bot
bc2c73e499
Version v1.88.2
2023-11-21 15:01:06 +00:00
Alex The Bot
9cf40afaf0
Version v1.88.1
2023-11-21 03:00:19 +00:00
Alex The Bot
0f596e278c
Version v1.88.0
2023-11-20 20:47:37 +00:00
Mert
ddf04a7eb4
chore(ml): increase spool threshold to 64MiB ( #5176 )
2023-11-20 09:05:35 -06:00
Mert
f7ada7351e
update onnxruntime ( #5175 )
2023-11-20 08:44:45 -06:00
Alex The Bot
ec51a9f6d6
Version v1.87.0
2023-11-18 02:58:26 +00:00
Mert
a6af4892e3
fix(ml): better model unloading ( #3340 )
...
* restart process on inactivity
* formatting
* always update `last_called`
* load models sequentially
* renamed variable, updated docs
* formatting
* made poll env name consistent with model ttl env
2023-11-16 20:42:44 -06:00
Alex The Bot
a7cacafe25
Version v1.86.0
2023-11-14 04:08:18 +00:00
Mert
291159e7fc
fixed tests ( #5017 )
2023-11-13 19:37:39 +00:00
Mert
935f471ccb
chore(ml): use strict mypy ( #5001 )
...
* improved typing
* improved export typing
* strict mypy & check export folder
* formatting
* add formatting checks for export folder
* re-added init call
2023-11-13 10:18:46 -06:00
Mert
328a58ac0d
feat(ml): add face models ( #4952 )
...
added models to config dropdown
fixed downloading
updated tests
use hf for face models
formatting
2023-11-11 19:04:49 -06:00
Alex The Bot
37ab37bffc
Version v1.85.0
2023-11-08 03:20:59 +00:00
Alex The Bot
cf4ec06750
Version v1.84.0
2023-11-01 14:46:59 +00:00
Mert
87a0ba3db3
feat(ml): export clip models to ONNX and host models on Hugging Face ( #4700 )
...
* export clip models
* export to hf
refactored export code
* export mclip, general refactoring
cleanup
* updated conda deps
* do transforms with pillow and numpy, add tokenization config to export, general refactoring
* moved conda dockerfile, re-added poetry
* minor fixes
* updated link
* updated tests
* removed `requirements.txt` from workflow
* fixed mimalloc path
* removed torchvision
* cleaner np typing
* review suggestions
* update default model name
* update test
2023-10-31 05:02:04 -05:00
Alex The Bot
d98a2a5f79
Version v1.83.0
2023-10-28 13:32:48 +00:00
Alex The Bot
31987bc043
Version v1.82.1
2023-10-18 17:14:26 +00:00
Alex The Bot
219f99e516
Version v1.82.0
2023-10-17 01:24:08 +00:00
Mert
d8ecefaea5
chore(ml): removed vit-b check and st warning ( #4422 )
2023-10-10 12:26:30 -05:00
Alex The Bot
126dd45751
Version v1.81.1
2023-10-04 17:53:42 +00:00
Alex The Bot
81d51fbd7e
Version v1.81.0
2023-10-03 20:48:23 +00:00
Alex The Bot
66e860a08e
Version v1.80.0
2023-10-02 14:47:21 +00:00
Alex The Bot
e050121dbf
Version v1.79.1
2023-09-22 01:37:20 +00:00
Alex The Bot
86f5ceb80e
Version v1.79.0
2023-09-21 14:17:00 +00:00
Alex The Bot
a3206bf950
Version v1.78.1
2023-09-14 13:56:33 +00:00
Alex The Bot
b42ca61e1f
Version v1.78.0
2023-09-13 08:24:02 +00:00
Mert
cb437829f3
chore(docs): updated ML documentation ( #4063 )
2023-09-12 13:22:42 +07:00
Mert
258b98c262
fix(ml): load models in separate threads ( #4034 )
...
* load models in thread
* set clip mode logs to debug level
* updated tests
* made fixtures slightly less ugly
* moved responses to json file
* formatting
2023-09-09 16:02:44 +07:00
Alexandre Bouijoux
b8777d7739
Add french documentation ( #4010 )
...
* Copy original README for online editing
* Translate to french
* Add link from other documentations
* Add machine-learning french doc
* Typos
* Missing word
---------
Co-authored-by: Alexandre Bouijoux <alexandre@bouijoux.fr>
2023-09-08 13:48:39 +07:00
Mert
0a24ff90bb
fix(ml): set higher default worker timeout ( #4007 )
2023-09-07 08:27:29 +07:00
Alex The Bot
608543da0b
Version v1.77.0
2023-09-06 03:30:44 +00:00
Mert
3cf0f5f11b
fix(ml): model downloading improvements ( #3988 )
...
* handle ort `NoSuchFile` error, stricter file check
* keep exception order
2023-09-06 08:48:40 +07:00
Mert
b7fd5dcb4a
dev(ml): fixed docker-compose.dev.yml, updated locust ( #3951 )
...
* fixed dev docker compose
* updated locustfile
* deleted old script, moved comments to locustfile
2023-09-01 21:59:17 -04:00
Daniele Ricci
c7d53a5006
docs: remove obsolete environment variables ( #3926 )
...
* Obsolete environment variables
* Review fixes
* Review fixes
* Review fixes
2023-09-01 18:05:45 +07:00
Mert
41461e0d5d
chore(ml): memory optimisations ( #3934 )
2023-08-31 18:30:53 -05:00
Alex The Bot
58ae734fc2
Version v1.76.1
2023-08-30 08:26:04 +00:00
Mert
54b2779b79
chore(ml): improved logging ( #3918 )
...
* fixed `minScore` not being set correctly
* apply to init
* don't send `enabled`
* fix eslint warning
* added logger
* added logging
* refinements
* enable access log for info level
* formatting
* merged strings
---------
Co-authored-by: Alex <alex.tran1502@gmail.com>
2023-08-30 08:22:01 +00:00
Mert
df26e12db6
fix(ml): minScore not being set correctly ( #3916 )
...
* fixed `minScore` not being set correctly
* apply to init
* don't send `enabled`
* fix eslint warning
* better error message
2023-08-30 03:16:00 -05:00
Alex The Bot
49c2d4d115
Version v1.76.0
2023-08-29 19:24:43 +00:00
Mert
bcc36d14a1
feat(ml)!: customizable ML settings ( #3891 )
...
* consolidated endpoints, added live configuration
* added ml settings to server
* added settings dashboard
* updated deps, fixed typos
* simplified modelconfig
updated tests
* Added ml setting accordion for admin page
updated tests
* merge `clipText` and `clipVision`
* added face distance setting
clarified setting
* add clip mode in request, dropdown for face models
* polished ml settings
updated descriptions
* update clip field on error
* removed unused import
* add description for image classification threshold
* pin safetensors for arm wheel
updated poetry lock
* moved dto
* set model type only in ml repository
* revert form-data package install
use fetch instead of axios
* added slotted description with link
updated facial recognition description
clarified effect of disabling tasks
* validation before model load
* removed unnecessary getconfig call
* added migration
* updated api
updated api
updated api
---------
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-08-29 08:58:00 -05:00
Alex The Bot
f1027d7807
Version v1.75.2
2023-08-26 22:34:54 +00:00
Alex The Bot
cc1fecfffd
Version v1.75.1
2023-08-26 18:31:14 +00:00
Alex The Bot
6fe214a784
Version v1.75.0
2023-08-26 04:44:39 +00:00
Mert
165b91b068
feat(ml)!: switch image classification and CLIP models to ONNX ( #3809 )
2023-08-25 06:28:51 +02:00
Mert
60729a091a
make lazy loading default ( #3797 )
2023-08-20 18:24:14 -05:00
Alex The Bot
d2bad1d553
Version v1.74.0
2023-08-19 06:09:16 +00:00
Alex The Bot
a3b6095b61
Version v1.73.0
2023-08-15 12:45:48 +00:00
Mert
fa57853bd2
fix(ml): clear cache if bad zip file ( #3600 )
2023-08-08 12:33:13 -05:00
Alex The Bot
6efc2ec9be
Version v1.72.2
2023-08-07 16:41:17 +00:00
Alex The Bot
b3b5f063cf
Version v1.72.1
2023-08-07 02:54:24 +00:00
Alex The Bot
3edb347666
Version v1.72.0
2023-08-06 19:48:25 +00:00
Mert
c73832bd9c
refactor(ml): model downloading ( #3545 )
...
* download facial recognition models
* download hf models
* simplified logic
* updated `predict` for facial recognition
* ensure download method is called
* fixed repo_id for clip
* fixed download destination
* use st's own `snapshot_download`
* conditional download
* fixed predict method
* check if loaded
* minor fixes
* updated mypy overrides
* added pytest-mock
* updated tests
* updated lock
2023-08-05 21:45:13 -05:00
Jorge Avila
1cf3378499
Add Spanish translations of Readme ( #3511 )
2023-08-02 06:51:08 -05:00
Alex The Bot
3f1cf44717
Version v1.71.0
2023-07-28 18:32:33 +00:00
Alex The Bot
2872886e77
Version v1.70.0
2023-07-27 03:40:16 +00:00
Alex The Bot
f41e1159d1
Version v1.69.0
2023-07-23 17:40:02 +00:00
Mert
8f08100a30
moved deps ( #3379 )
2023-07-22 15:04:52 -05:00
bt90
bc885f3644
fix(server): properly handle SIGTERM ( #3350 )
...
* use tini init
* Move python into CMD
* Use tini as entrypoint
* Toggle executable bit
* Avoid compose changes
* Adapt web entrypoint
2023-07-21 09:20:04 -05:00
Alex The Bot
1835fbae49
Version v1.68.0
2023-07-20 03:06:12 +00:00
Alex The Bot
81e07fda08
Version v1.67.2
2023-07-14 14:01:20 +00:00
Alex The Bot
2d4e2af629
Version v1.67.1
2023-07-14 02:45:02 +00:00
Alex The Bot
cd184cf366
Version v1.67.0
2023-07-14 00:39:54 +00:00
Mert
848ba685eb
fix(ml): race condition when loading models ( #3207 )
...
* sync model loading, disabled model ttl by default
* disable revalidation if model unloading disabled
* moved lock
2023-07-11 12:01:21 -05:00
Alex The Bot
0d30ceb284
Version v1.66.1
2023-07-05 02:50:53 +00:00
Alex The Bot
8a3ab5be3e
Version v1.66.0
2023-07-04 15:51:53 +00:00
Alex The Bot
df9c05bef3
Version v1.65.0
2023-06-30 03:01:48 +00:00
Mert
df1e8679d9
chore(ml): added testing and github workflow ( #2969 )
...
* added testing
* github action for python, made mypy happy
* formatted with black
* minor fixes and styling
* test model cache
* cache test dependencies
* narrowed model cache tests
* moved endpoint tests to their own class
* cleaned up fixtures
* formatting
* removed unused dep
2023-06-27 18:21:33 -05:00
Mert
47982641b2
fix(ml): clear model cache on load error ( #2951 )
...
* clear model cache on load error
* updated caught exceptions
2023-06-27 16:01:24 -05:00
Mert
4d3ce0a65e
fixed setting different clip, removed unused stubs ( #2987 )
2023-06-27 12:21:50 -05:00
Alex The Bot
b258f3552a
Version v1.64.0
2023-06-26 18:06:11 +00:00
Mert
a58482cb2b
added locustfile ( #2926 )
2023-06-25 13:20:45 -05:00
Mert
a2f5674bbb
refactor(ml): modularization and styling ( #2835 )
...
* basic refactor and styling
* removed batching
* module entrypoint
* removed unused imports
* model superclass, model cache now in app state
* fixed cache dir and enforced abstract method
---------
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-06-24 22:18:09 -05:00
Mert
837ad24f58
fix(deps): install poetry in pump workflow ( #2938 )
...
* install poetry in pump workflow
* formatting
2023-06-24 22:03:50 -05:00
Zeeshan Khan
34201be74c
feat(ml) backend takes image over HTTP ( #2783 )
...
* using pydantic BaseSetting
* ML API takes image file as input
* keeping image in memory
* reducing duplicate code
* using bytes instead of UploadFile & other small code improvements
* removed form-multipart, using HTTP body
* format code
---------
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2023-06-17 22:49:19 -05:00
renovate[bot]
0909335d02
chore(deps): update python:3.11.4-slim-bullseye docker digest to 91d194f ( #2797 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-06-16 11:38:59 -05:00
renovate[bot]
827e4b5f75
chore(deps): update python:3.11.4-bullseye docker digest to 5b40167 ( #2796 )
...
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2023-06-16 11:17:23 -05:00
Thomas
16171eee8d
pin image digests ( #2754 )
...
Manifest list digests can be found with:
```sh
docker buildx imagetools inspect python:3.11.4-bullseye
docker buildx imagetools inspect python:3.11.4-slim-bullseye
docker buildx imagetools inspect ghcr.io/nginxinc/nginx-unprivileged:1.25.0-alpine3.17
```
The node images are pinned in #2736
Fixes #2751
Partially fixes #2752
2023-06-16 10:28:41 -05:00
Mert
d0cc231782
feat(ml): model unloading ( #2661 )
...
* model cache
* fixed revalidation when using cache namespace
* fixed ttl not being set, added lock
2023-06-06 20:48:51 -05:00
Mert
1e748864c5
chore(ml): updated dockerfile, added typing, packaging ( #2642 )
...
* updated dockerfile, added typing, packaging
apply env change
* added arm64 support
* added ml version pump, second try for arm64
* added linting config to pyproject.toml
* renamed ml input field
* fixed linter config
* fixed dev docker compose
2023-06-05 09:40:48 -05:00
Mert
b8de668f5f
feat(ml): env variables for tags, faces and eager startup ( #2626 )
...
* env variables for tags, faces and eager startup
* chore(server,ml): remove object detection job and endpoint (#2627 )
* removed object detection job
* removed object detection endpoint
* env variables for tags, faces and eager startup
* download without caching models if not eager
* simplified `get_cached_model`
* re-added env for clip text model
2023-06-02 21:42:47 -05:00
Mert
631f13cf2f
chore(server,ml): remove object detection job and endpoint ( #2627 )
...
* removed object detection job
* removed object detection endpoint
2023-05-31 20:49:51 -05:00
Alex
84cfa38510
chore(ml): load models on start up ( #2487 )
...
* chore(ml): load models on start up
* Download correct model
2023-05-19 22:37:01 -05:00
Jason Rasmussen
93863b0629
feat: facial recognition ( #2180 )
2023-05-17 12:07:17 -05:00
Alex
8cc9b08c06
chore(ml): use official pytorch channel ( #2416 )
2023-05-10 07:09:33 -05:00
bo0tzz
b6b9f51bd7
chore(ml): Fix entrypoint path ( #2373 )
2023-05-03 14:27:35 -05:00
Alex
7e965cb6d4
chore(ml): move to fastAPI ( #2336 )
2023-04-26 05:39:24 -05:00
Alex Tran
08b424b3df
update gitignore
2023-04-22 13:31:42 -05:00
Devin Buhl
2dcccb37a0
chore(docker): Default NODE_ENV to production for server image and update alpine version ( #2157 )
...
* default NODE_ENV to production for server image
* update node image to use 3.17 alpine in server
* update web docker image to use alpine 3.17
* remove NODE_ENV from production docker-compose
* NODE_ENV is also needed default in machine-learning
2023-04-03 15:05:29 -05:00
Alex
f56eaae019
feat(server): CLIP search integration ( #1939 )
2023-03-18 08:44:42 -05:00
Olly Welch
d5d0624311
Feat/ml image optimisations ( #1916 )
...
* Use multi stage build to slim down ML image size
* Use gunicorn as WSGI server in ML image
* Configure gunicorn server for ML use case
* Use requirements.txt file to install python dependencies in ML image
* Make ML listen IP configurable
* Revert "Use requirements.txt file to install python dependencies in ML image"
This reverts commit 32e706c7f3
2023-03-03 16:45:20 -06:00
Zack Pollard
1cc184ed10
Revert "feat(server): Machine learning's image optimisations ( #1908 )" ( #1915 )
...
This reverts commit 977740045a
2023-03-01 11:48:35 -06:00
Olly Welch
977740045a
feat(server): Machine learning's image optimisations ( #1908 )
...
* Use multi stage build to slim down ML image size
* Use gunicorn as WSGI server in ML image
* Configure gunicorn server for ML use case
* Use requirements.txt file to install python dependencies in ML image
* Make ML listen IP configurable
2023-03-01 09:37:12 -06:00
Olly Welch
ab90b01122
feat(server) Enable ML support for ARM CPUs ( #1880 )
...
* Install nightly release of pytorch to enable ML support for arm CPUs
* Remove linux/arm/v7 from ML docker builds
* Add --no-cache-dir to torch installation command in ML image build
* Use PIP_NO_CACHE_DIR option in ML build to further decrease image size
2023-02-26 15:00:09 -06:00
Zack Pollard
3d468c369c
fix: machine learning only take results with > 90% confidence ( #1875 )
2023-02-25 22:02:35 -06:00
Skyler Mäntysaari
b00631d186
fix(machine-learning): Add the command to execute at startup ( #1843 )
...
* fix(machine-learning): Add the command to execute at startup
Previously it wasn't set in the Docker container but it should be.
* fix(docker): remove machine-learning command arg
* fix(docker): machine-learning CMD argument
2023-02-23 09:54:04 -06:00
Alex
a3b9a0be3a
fix(server): Flask not found ( #1830 )
...
* fix(server): Flask not found
* trial 1
2023-02-22 10:53:59 -06:00
Alex
57136e48fb
feat(machine-learning)!: move machine learning to Python based image ( #1774 )
...
BREAKING CHANGES
* Users have to update the docker-compose file, machine-learning portion.
* Temporary dropping machine-learning support for Arm64 and Armv7
2023-02-18 09:13:37 -06:00
Zack Pollard
43da8c2a72
chore: reduce docker image size ( #1523 )
...
* chore: remove @tensorflow/tfjs-node-gpu as it is unused
* chore: remove ffmpeg from machine-learning docker image
* chore: remove unneeded dependencies + move dev dependencies in server
* chore: reduce server image size
* chore: machine-learning remove extraneous dependencies
* chore: web remove extraneous dependencies
* chore: web Dockerfile reduce production image size
* chore: add exiftool-vendored.pl as a dependency
2023-02-02 21:28:34 -06:00
Skyler Mäntysaari
9d337bf4dc
feat(server/machine-learning): Configurable port ( #1386 )
...
* feat(server/machine-learning): Configurable port
* feat(server/machine-learning): Address PR comments.
* feat(server/machine-learning): Simplify
Co-authored-by: Alex <alex.tran1502@gmail.com>
2023-01-23 22:18:35 -06:00
bt90
16b763e086
fix(docker-build): start main process with exec ( #1210 )
...
* Use exec
* Appl shellcheck fixes
* Close with newline
2022-12-29 14:49:02 -06:00
Jason Rasmussen
2e4c005ad9
refactor: multistage builds ( #955 )
2022-11-10 22:22:17 -06:00
Alex Tran
c3348bd068
Fixed Dockerfile not working in dev
2022-11-09 23:34:35 -06:00
Jason Rasmussen
cc61729f01
build(server): use github-action cache ( #949 )
...
* build(server): prune dependencies in docker builder
* fix: e2e tests
* refactor: dockerfile step order
* fix: vips build dependency
* feat: use caching
2022-11-09 19:53:21 -06:00
Alex
676ad2d34f
chore(server) revert Dockerfile ( #878 )
2022-10-27 17:21:28 -05:00
Jonas Janz
b713fb5650
feat(docker) revert ubuntu base image ( #863 )
...
* feat(docker) revert ubuntu base image
This PR reverts the base image for immich-server back to alpine
Adds LICENSE to all Images
Quiets apt-get commands when building
ensures write-permission for root group on app folders
Signed-off-by: PixelJonas <5434875+PixelJonas@users.noreply.github.com>
* Test build old Docker content
* Revert and retry
Signed-off-by: PixelJonas <5434875+PixelJonas@users.noreply.github.com>
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2022-10-25 14:18:37 -05:00
Alex
c3979f6e31
fix(machine-learning) Remove unsused database config ( #745 )
2022-09-23 19:00:47 -05:00
Alex
c436c57cc9
Fixed immich-machine-learning container not starting correctly in production
2022-08-20 23:04:10 -07:00
Alex
10ef3509dd
Fixed machine-learning container cannot start prod
2022-08-20 22:27:25 -07:00
Alex
3dc538f9e6
Fixed machine-learning container cannot start prod
2022-08-20 22:26:47 -07:00
Thanh Pham
1e29ff322d
build(server): minimal container ( #506 )
...
* build(server): update Dockerfile
* build(server): fix dockerfile
* build(machine-learning): multiple build stages
* build(server): update Dockerfile
2022-08-20 21:19:02 -07:00
bo0tzz
a35460cb84
Bump tfjs version to 3.19.0 for arm64 support ( #368 )
...
* Add linux/arm64 to machine-learning container build
* Bump tfjs version to 3.19.0
* Fix tfjs dependency error
2022-07-23 14:15:55 -05:00
Fynn Petersen-Frey
d69470e207
Add extended redis & DB port configuration via environment variables ( #330 )
...
* Add database port configuration via env variable
Add redis connection configuration via env variables
* Add redis connection configuration via env variables
2022-07-12 22:21:11 -05:00
Jaime Baez
355038a91a
Use npm ci for installing pacakages ( #304 )
2022-07-04 13:47:25 -05:00
Zack Pollard
c071e64a7e
infra: switch port to 3003 for machine learning container ( #290 )
...
* infra: switch port to 3003 for machine learning container
fixes #289
* Changed port of machine-learning-endpoint to match with new port
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2022-07-01 10:20:04 -05:00
Alex
a8220172f8
WIP refactor container and queuing system ( #206 )
...
* refactor microservices to machine-learning
* Update tGithub issue template with correct task syntax
* Added microservices container
* Communicate between service based on queue system
* added dependency
* Fixed problem with having to import BullQueue into the individual service
* Added todo
* refactor server into monorepo with microservices
* refactor database and entity to library
* added simple migration
* Move migrations and database config to library
* Migration works in library
* Cosmetic change in logging message
* added user dto
* Fixed issue with testing not able to find the shared library
* Clean up library mapping path
* Added webp generator to microservices
* Update Github Action build latest
* Fixed issue NPM cannot install due to conflict witl Bull Queue
* format project with prettier
* Modified docker-compose file
* Add GH Action for Staging build:
* Fixed GH action job name
* Modified GH Action to only build & push latest when pushing to main
* Added Test 2e2 Github Action
* Added Test 2e2 Github Action
* Implemented microservice to extract exif
* Added cronjob to scan and generate webp thumbnail at midnight
* Refactor to ireduce hit time to database when running microservices
* Added error handling to asset services that handle read file from disk
* Added video transcoding queue to process one video at a time
* Fixed loading spinner on web while loading covering the info panel
* Add mechanism to show new release announcement to web and mobile app (#209 )
* Added changelog page
* Fixed issues based on PR comments
* Fixed issue with video transcoding run on the server
* Change entry point content for backward combatibility when starting up server
* Added announcement box
* Added error handling to failed silently when the app version checking is not able to make the request to GITHUB
* Added new version announcement overlay
* Update message
* Added messages
* Added logic to check and show announcement
* Add method to handle saving new version
* Added button to dimiss the acknowledge message
* Up version for deployment to the app store
2022-06-11 16:12:06 -05:00
