Commit graph

216 commits

Author SHA1 Message Date
martylukyy
82331c3d34
fix(database): duplicate skip_clean_sanitize column (#2096)
* fix(database): duplicate `skip_clean_sanitize` column

* fix(db/sqlite): add skip_clean_sanitize to initial schema

---------

Co-authored-by: ze0s <ze0s@riseup.net>
2025-06-11 12:25:17 +02:00
martylukyy
a8b4ca69a2
feat(indexers): new IRC auth mechanism for RocketHD (#2085)
* chore(indexers): new IRC auth mechanism for RocketHD

* linting

* chore(indexers): remove NickServ fields from settings

* chore(indexers): database migrations

* chore(indexers): only do irc_channel migrations when password is not NULL

* feat(indexers): only bump schema once

* feat(indexers): add migrations for postgres
2025-06-10 19:50:19 +02:00
ze0s
46f6fbe5cc
feat(feeds): optimize existing cache items check (#2078)
* feat(feeds): optimize existing items cache check

* feat(feeds): remove ttl from repo method ExistingItems

* feat(feeds): add db integration test for ExistingItems

* feat(feeds): improve release and filter processing

* feat(feeds): fix failing test
2025-06-07 12:46:08 +02:00
Lucian Maly
4ce2241991
feat(lists): add option to skip cleaning of Plaintext data (#2036)
* Added: Plaintext untouched

* Revert "Added: Plaintext untouched"

This reverts commit e6ceaec5f4776cfc8335ae2c02e1caa4a2bbb0bc.

* Added: skipCleanSanitize

* TS definition for List object doesn't yet know about the new skip_clean_sanitize property

* Update: ListForms.tsx with the bypass option

* Update: Database internals for skip_clean_sanitize

* Fix: Snake case
2025-06-01 15:27:48 +02:00
ze0s
fe4f385a22
feat(database): connect postgres via socket and read config from env _FILE secrets (#2061)
* feat(database): connect postgres via socket

* feat(config): read env var secrets from file

* docs: explain env var secrets

* refactor: generate postgres dsn
2025-05-05 21:15:24 +02:00
ze0s
ef7317dde6
feat(filters): show current download count in list (#2001)
* feat(filters): show current and max downloads in list

* feat(filters): remove unused func param
2025-03-16 18:33:47 +01:00
ze0s
9eff694a5f
fix(notifications): update and list password (#1951) 2025-01-25 18:34:49 +01:00
soup
25574446f7
chore(license): update copyright year in headers (#1935) 2025-01-08 08:38:10 +01:00
soup
0391629862
chore(license): update copyright year in headers (#1929)
* chore: update copyright year in license headers

* Revert "chore: update copyright year in license headers"

This reverts commit 3e58129c431b9a491089ce36b908f9bb6ba38ed3.

* chore: update copyright year in license headers

* fix: sort go imports

* fix: add missing license headers
2025-01-06 22:23:19 +01:00
ze0s
6b4f1d9f63
fix(database): migrations to update PTP IRC channel (#1906)
* fix(database): migrations to update PTP IRC channel

* refactor(web): remove channel disable logic from IRC forms

---------

Co-authored-by: s0up4200 <s0up4200@pm.me>
2024-12-28 14:45:45 +01:00
ze0s
af3907df9b
fix(releases): handle NULL hybrid field (#1905) 2024-12-27 17:06:51 +01:00
ze0s
7bb3487e5e
fix(lists): handle NULL clientID for non-arr lists on Postgres (#1904)
fix(lists): handle NULL clientID for Postgres
2024-12-27 16:06:05 +01:00
ze0s
0cf704dba3
fix(releases): add null handling for new fields (#1892)
* fix(web): react fragment props warnings

* fix(releases): handle new NULL values
2024-12-26 01:04:39 +01:00
ze0s
ea20fb4f50
feat(filters): set default Announce Type to NEW (#1890)
feat(filters): set default announce type NEW
2024-12-25 23:38:56 +01:00
ze0s
2c0672f4bc
fix(indexers): PTP update IRC channel (#1889)
* fix(indexers): PTP update IRC channel

* fix(database): add migrations for PTP IRC channel update

* fix(database): update PTP IRC channel references in invite commands

---------

Co-authored-by: s0up4200 <s0up4200@pm.me>
2024-12-25 22:51:01 +01:00
kenstir
4009554d10
feat(filters): skip duplicates (#1711)
* feat(filters): skip duplicates

* fix: add interface instead of any

* fix(filters): tonullint

* feat(filters): skip dupes check month day

* chore: cleanup

* feat(db): set autoincrement id

* feat(filters): add repack and proper to dupe profile

* feat(filters): add default dupe profiles

* feat(duplicates): check audio and website

* feat(duplicates): update tests

* feat(duplicates): add toggles on addform

* feat(duplicates): fix sqlite upgrade path and initialize duplicate profiles

* feat(duplicates): simplify sqlite upgrade

avoiding temp table and unwieldy select.  Besides, FK constraints
are turned off anyway in #229.

* feat(duplicates): change CheckIsDuplicateRelease treatment of PROPER and REPACK

"Proper" and "Repack" are not parallel to the other conditions like "Title",
so they do not belong as dedup conditions.  "PROPER" means there was an issue in
the previous release, and so a PROPER is never a duplicate, even if it replaces
another PROPER.  Similarly, "REPACK" means there was an issue in the previous
release by that group, and so it is a duplicate only if we previously took a
release from a DIFFERENT group.

I have not removed Proper and Repack from the UI or the schema yet.

* feat(duplicates): update postgres schema to match sqlite

* feat(duplicates): fix web build errors

* feat(duplicates): fix postgres errors

* feat(filters): do leftjoin for duplicate profile

* fix(filters): partial update dupe profile

* go fmt `internal/domain/filter.go`

* feat(duplicates): restore straightforward logic for proper/repack

* feat(duplicates): remove mostly duplicate TV duplicate profiles

Having one profile seems the cleanest.  If somebody wants multiple
resolutions then they can add Resolution to the duplicate profile.
Tested this profile with both weekly episodic releases and daily
show releases.

* feat(release): add db indexes and sub_title

* feat(release): add IsDuplicate tests

* feat(release): update action handler

* feat(release): add more tests for skip duplicates

* feat(duplicates): check audio

* feat(duplicates): add more tests

* feat(duplicates): match edition cut and more

* fix(duplicates): tests

* fix(duplicates): missing imports

* fix(duplicates): tests

* feat(duplicates): handle sub_title edition and language in ui

* fix(duplicates): tests

* feat(duplicates): check name against normalized hash

* fix(duplicates): tests

* chore: update .gitignore to ignore .pnpm-store

* fix: tests

* fix(filters): tests

* fix: bad conflict merge

* fix: update release type in test

* fix: use vendored hot-toast

* fix: release_test.go

* fix: rss_test.go

* feat(duplicates): improve title hashing for unique check

* feat(duplicates): further improve title hashing for unique check with lang

* feat(duplicates): fix tests

* feat(duplicates): add macros IsDuplicate and DuplicateProfile ID and name

* feat(duplicates): add normalized hash match option

* fix: headlessui-state prop warning

* fix(duplicates): add missing year in daily ep normalize

* fix(duplicates): check rejections len

---------

Co-authored-by: ze0s <ze0s@riseup.net>
2024-12-25 22:33:46 +01:00
soup
d153ac44b8
feat(filters): RED and OPS fetch record label from API (#1881)
* feat(filters): RED and OPS fetch record label from API

* test: add record label to RED and OPS test data

* refactor: record label check

---------

Co-authored-by: ze0s <ze0s@riseup.net>
2024-12-25 13:39:03 +01:00
ze0s
221bc35371
feat(lists): integrate Omegabrr (#1885)
* feat(lists): integrate Omegabrr

* feat(lists): add missing lists index

* feat(lists): add db repo

* feat(lists): add db migrations

* feat(lists): labels

* feat(lists): url lists and more arrs

* fix(lists): db migrations client_id wrong type

* fix(lists): db fields

* feat(lists): create list form wip

* feat(lists): show in list and create

* feat(lists): update and delete

* feat(lists): trigger via webhook

* feat(lists): add webhook handler

* fix(arr): encode json to pointer

* feat(lists): rename endpoint to lists

* feat(lists): fetch tags from arr

* feat(lists): process plaintext lists

* feat(lists): add background refresh job

* run every 6th hour with a random start delay between 1-35 seconds

* feat(lists): refresh on save and improve logging

* feat(lists): cast arr client to pointer

* feat(lists): improve error handling

* feat(lists): reset shows field with match release

* feat(lists): filter opts all lists

* feat(lists): trigger on update if enabled

* feat(lists): update option for lists

* feat(lists): show connected filters in list

* feat(lists): missing listSvc dep

* feat(lists): cleanup

* feat(lists): typo arr list

* feat(lists): radarr include original

* feat(lists): rename ExcludeAlternateTitle to IncludeAlternateTitle

* fix(lists): arr client type conversion to pointer

* fix(actions): only log panic recover if err not nil

* feat(lists): show spinner on save

* feat(lists): show icon in filters list

* feat(lists): change icon color in filters list

* feat(lists): delete relations on filter delete
2024-12-25 13:23:37 +01:00
ze0s
96f61a90e5
fix(database): SQLite try reindexing on integrity check error (#1877)
* fix(database): SQLite try reindexing on consistency error

* fix(database): SQLite return err if no bad indexes found
2024-12-14 15:58:18 +01:00
Kyle Sanderson
81ce8acb2b
fix(releases): search by group (#1876)
fix(search): regression on group
2024-12-12 13:56:04 +01:00
ze0s
f644b3a4d6
feat(filters): implement AnnounceType (#1837)
* feat(filters): implement AnnounceType

* fix: rss tests
2024-12-08 21:08:24 +01:00
Kyle Sanderson
f292d2709b
fix(database): backup on windows bad filename (#1841)
* fix(migrations): use safe characters during backup

* remove _ because of splits

* Update sqlite.go

* flip
2024-11-25 10:59:40 +01:00
ze0s
2dcd876068
fix(database): SeedPool migrations (#1838) 2024-11-24 21:51:47 +01:00
ze0s
be9a956598
feat(indexers): update SeedPool IRC announce parsing (#1835)
* feat(indexers): update SeedPool IRC port

* feat(indexers): SeedPool add db migration

* fix(indexers): adapt regex, tests and vars

* fix(indexers): set internal var to origin to fix parsing

---------

Co-authored-by: martylukyy <35452459+martylukyy@users.noreply.github.com>
2024-11-24 18:34:40 +01:00
ze0s
b0a30dd136
feat(indexers): REDACTED update urls (#1830)
* feat(indexers): REDACTED update urls

* feat(databse): REDACTED update urls in db with migrations
2024-11-24 14:07:45 +01:00
martylukyy
74eea79215
feat(database): SQLite database backups (#1756)
* feat(database): SQLite database backups

* feat(database): do not produce SQL injections

* feat(database): retain all backups if 0 or less
refactor(database): specify database driver in func names

* refactor(database): return early on cleanup

* refactor(database): do not call cleanup func if max backups set to 0

* refactor(database): backup retention behavior

* feat(database): improve logging

---------

Co-authored-by: ze0s <43699394+zze0s@users.noreply.github.com>
2024-11-12 19:14:45 +01:00
ze0s
1227657ae8
feat(indexers): FearNoPeer update IRC server (#1816)
* feat(indexers): update FearNoPeer IRC server

* Update FNP irc server and add migrations for SceneHD and BitHUmen changes all in one.

The update for FNP from LibraIRC to P2P-Network will set the nick to nick_0 to not cause any UNIQUE constraint issues. Users will have to update or merge with existing P2P-Network config.
2024-11-09 16:06:35 +01:00
soup
b4f0d60b9b
chore: add missing license headers (#1811)
* chore: add missing license headers

* missing license in test files
2024-11-06 21:37:42 +01:00
ze0s
40fe3e9f54
fix(indexers): delete feed with indexer (#1810)
* fix(indexers): delete feed in one go

* fix(indexers): sort imports

* refactor(feeds): db methods for find
2024-11-06 20:48:46 +01:00
ze0s
59c5858bf0
fix(releases): update size after actions run (#1809) 2024-11-06 18:55:00 +01:00
martylukyy
509e4ddaed
fix(indexers): update Fuzer IRC addr (#1764) 2024-10-09 15:44:46 +02:00
Carmelo Scandaliato
d15b61870e
fix(filters): release download counts (#1739)
* fix(database): count multiple actions per filter as one download

* fix(database): change queries and add tests

* fix(releases): add additional testdata

---------

Co-authored-by: ze0s <ze0s@riseup.net>
2024-10-06 14:52:20 +02:00
ze0s
ca2d956e02
fix(notifications): disable notification and events have no effect (#1754)
fix(notifications): disable notificatio nand events
2024-10-06 14:12:01 +02:00
martylukyy
ec79eafe43
feat(notifications): optional Telegram sender (#1726)
refactor(notifications): optional Telegram sender
2024-09-17 17:07:58 +02:00
Kyle Sanderson
ea25b6bb7f
feat(database): add missing filter indexes (#1712)
* feat(sqlite): add missing filter indexes

* _index

* feat(database): add missing filter indexes postgres

---------

Co-authored-by: ze0s <43699394+zze0s@users.noreply.github.com>
2024-09-17 15:52:41 +02:00
martylukyy
490308c9c6
fix(indexers): new baseURL for Fuzer (#1724)
* fix(indexers): new URL for Fuzer

* fix(indexers): add database migrations
2024-09-17 15:09:23 +02:00
ze0s
fd90020400
feat(releases): show indexer name instead of identifier (#1706)
* feat(releases): show indexer name instead of identifier

* feat(releases): remove log in Cell

* feat(releases): update Dashboard recent releases

* fix(releases): db tests

* fix(releases): remove unused code

* fix(releases): remove more unused code

* fix(releases): remove even more unused code

---------

Co-authored-by: martylukyy <35452459+martylukyy@users.noreply.github.com>
2024-09-03 14:57:48 +02:00
Kyle Sanderson
982f7ddf68
refactor(wildcard): optimize and add caching (#1634)
* fix(wildcard): avoid excessive allocations every loop

* are you going to Scarborough Fair?

* ruby ruby ruby ruby

* ride on, little murphy

* shirley?

* to the moon

* reggie are you there?

* code 99

* my doctorate is in Art History

* helps to be consistent

* tidy

* slow and steady gets the clam

* oysters were better anyway

* DIAL TONE
2024-09-02 11:18:14 +02:00
ze0s
bc0f4cc055
feat: add support for proxies to use with IRC and Indexers (#1421)
* feat: add support for proxies

* fix(http): release handler

* fix(migrations): define proxy early

* fix(migrations): pg proxy

* fix(proxy): list update delete

* fix(proxy): remove log and imports

* feat(irc): use proxy

* feat(irc): tests

* fix(web): update imports for ProxyForms.tsx

* fix(database): migration

* feat(proxy): test

* feat(proxy): validate proxy type

* feat(proxy): validate and test

* feat(proxy): improve validate and test

* feat(proxy): fix db schema

* feat(proxy): add db tests

* feat(proxy): handle http errors

* fix(http): imports

* feat(proxy): use proxy for indexer downloads

* feat(proxy): indexerforms select proxy

* feat(proxy): handle torrent download

* feat(proxy): skip if disabled

* feat(proxy): imports

* feat(proxy): implement in Feeds

* feat(proxy): update helper text indexer proxy

* feat(proxy): add internal cache
2024-09-02 11:10:45 +02:00
ze0s
acb91e8709
feat(http): implement missing findByID methods (#1635)
* feat(http): implement missing methods

* general cleanup
* unify param handling
* handle not found errors
* unify err handlers

* fix(http): fmt type
2024-08-29 12:22:03 +02:00
ze0s
accc875960
feat(database): improve error handling (#1633) 2024-08-29 09:00:53 +02:00
ze0s
d13b421c42
refactor(http): api key cache handling (#1632) 2024-08-28 16:51:03 +02:00
ze0s
0d53f7e5fc
feat(download-clients): rtorrent support Digest Auth (#1596)
* feat(download-clients): rtorrent support basic auth

* feat(download-client): implement new auth logic

* fix(download-client): tests store

* chore(deps): update go-rtorrent to v1.11.0
2024-08-28 12:21:56 +02:00
ze0s
861f30c144
fix(actions): reject if client is disabled (#1626)
* fix(actions): error on disabled client

* fix(actions): sql scan args

* refactor: download client cache for actions

* fix: tests client store

* fix: tests client store and int conversion

* fix: tests revert findbyid ctx timeout

* fix: tests row.err

* feat: add logging to download client cache
2024-08-27 19:45:06 +02:00
ze0s
abfac05b66
fix(releases): retry action missing external indexer identifier (#1612)
* fix(releases): retry action missing external identifier

* fix(actions): arrs set fallback indexer identifier
2024-08-11 20:39:11 +02:00
kenstir
4fceccd611
feat(filters): support daily shows (#1462)
* feat(database): Add month, day columns to release table

* feat(database): Add month, day columns to postgres release table

* feat(filters): support daily show format

* feat(filters): check smart episode daily

* fix(tests): rss

* feat(filters): add daily shows elements to form

* enhancement(web): minimize html in MoviesAndTV tab

* feat(filters): smart episode check proper and repack

* feat(filters): smart episode do not allow multiple latest

* feat(filters): smart episode check group with repack

* feat(filters): smart episode allow multiple current releases

---------

Co-authored-by: s0up4200 <soup@r4tio.dev>
Co-authored-by: ze0s <43699394+zze0s@users.noreply.github.com>
Co-authored-by: martylukyy <35452459+martylukyy@users.noreply.github.com>
2024-05-15 16:38:10 +02:00
ze0s
0016228d89
feat(indexers): add External Identifier to map with ARR indexers (#1534)
* feat(indexers): add External Identifier to map with ARR indexers

* fix: web build

* fix: tests

* feat: set identifier for manual processing
2024-05-04 12:37:01 +02:00
ze0s
3202c6043d
feat(indexers): update release baseurl on update (#1532) 2024-05-03 11:32:56 +02:00
soup
19e129e55f
feat(releases): delete based on age/indexer/status (#1522)
* feat(releases): delete based on age/indexer/status

* fix: sanitize releaseStatuses

* swap to RMSC

* add AgeSelect component

* improve texts

* refactor: streamline form layout

* improve text

* remove a paragraph

* improved UX

explaining the options, better error handling

* reinstate red border

* fix: labels to match other similar labels for selects

- improved contrast for the word "required" in desc
- added red asterisk to required select

* minor text improvement to warning

* fix: delete-button vertical alignment

* feat: cleanup queries

* feat: cleanup delete

---------

Co-authored-by: ze0s <ze0s@riseup.net>
2024-05-03 11:32:20 +02:00
kenstir
575944de1e
chore(database): remove unused test func (#1465)
chore(database): Remove unused func
2024-04-19 14:08:58 +02:00