Commit Graph

3631 Commits

Author SHA1 Message Date
Chocobozzz
f959b51824
Fix broken merge 2023-01-19 14:00:37 +01:00
Chocobozzz
6e06694fd6
Fix semver comparison 2023-01-19 13:54:53 +01:00
Chocobozzz
f008e9f3f3
Add missing url unique index in local video viewer 2023-01-19 13:54:52 +01:00
Chocobozzz
b379759f55 Add signup approval API tests 2023-01-19 13:53:40 +01:00
Chocobozzz
e364e31e25 Implement signup approval in server 2023-01-19 13:53:40 +01:00
Chocobozzz
eba2a7a834
Don't need a special comment sort function 2023-01-12 11:19:42 +01:00
Chocobozzz
0b96a0fb77
Optimize again comments list sql query 2023-01-12 11:11:41 +01:00
Chocobozzz
3f3530c3db
Merge branch 'release/5.0.0' into develop 2023-01-12 08:54:13 +01:00
Chocobozzz
8180f60477
Fix ACL incompatibility with some s3 providers
We'll move to another method in the future

See https://github.com/Chocobozzz/PeerTube/issues/5497
2023-01-12 08:41:16 +01:00
Chocobozzz
9ec435c85d
Increase tests timeout 2023-01-11 08:44:06 +01:00
Chocobozzz
8c4bbd946d
Refactor model utils 2023-01-10 11:56:08 +01:00
Chocobozzz
a8749f7c3b
Fix comments SQL pagination 2023-01-10 09:17:23 +01:00
Chocobozzz
1c30b112b9
Fix lint 2023-01-09 14:42:52 +01:00
Chocobozzz
f99a3f7dce
Correctly fix build 2023-01-09 14:22:36 +01:00
Chocobozzz
eb66ee8835
Refactor table attributes 2023-01-09 10:29:23 +01:00
Chocobozzz
0a8a79552c
Merge branch 'feature/SO035' into develop 2023-01-09 09:44:00 +01:00
Chocobozzz
cde3d90ded
Use raw sql for comments 2023-01-09 09:29:02 +01:00
Chocobozzz
5847724474
Add tracker opentelemtry metrics 2023-01-05 10:19:51 +01:00
Chocobozzz
60bab7b540
Implement getServerListeningConfig plugin helper 2023-01-04 11:52:54 +01:00
Chocobozzz
60b880acdf
External auth can update user on login 2023-01-04 11:41:29 +01:00
Chocobozzz
7e0c26066a
External auth can set more user fields
videoQuota, videoQuotaDaily, adminFlags
2023-01-04 11:41:29 +01:00
Chocobozzz
b65f5367ba
Add ability to customize token lifetime 2023-01-04 11:41:29 +01:00
Chocobozzz
518c5cc62d
Try to debug a CI issue 2023-01-03 14:52:35 +01:00
Chocobozzz
25691c9930
Prefer using sequelize replacements even for tests 2023-01-03 14:23:42 +01:00
Chocobozzz
9972ace3a3
Merge branch 'release/5.0.0' into develop 2022-12-30 15:28:49 +01:00
Chocobozzz
54db8e3d5c
Fix P2P with object storage 2022-12-30 15:05:14 +01:00
Chocobozzz
0daaab0c0e
Try to fix github api rate limit 2022-12-29 10:24:06 +01:00
Chocobozzz
4fe7cde283
Fix build 2022-12-29 10:14:43 +01:00
Chocobozzz
7ce2eac8fc
Improve sync channel logging 2022-12-28 16:11:11 +01:00
Chocobozzz
ded68a9760
More robust short to complete uuid error handler 2022-12-28 14:42:48 +01:00
Chocobozzz
7a07da01c4
Improve upgrade documentation 2022-12-28 10:29:37 +01:00
Chocobozzz
03c9f04a47
Fix sync tests 2022-12-23 14:02:13 +01:00
Chocobozzz
1fed9cb8d3
Don't need to use redis to block tracker ips
There could be many of them, so reduce load by storing IPs directly
inside node memory
2022-12-23 13:40:42 +01:00
Chocobozzz
41027acb0a
Merge branch 'release/5.0.0' into develop 2022-12-21 10:56:57 +01:00
Chocobozzz
dfa4944f34
Fix local channel stats 2022-12-21 10:46:58 +01:00
Chocobozzz
ec3ce76f19
Prefer displaying channel in rss feeds 2022-12-20 09:28:01 +01:00
Chocobozzz
868314e8bf
Add ability to get user from file token 2022-12-20 09:15:49 +01:00
Chocobozzz
57e11a20f1
Forward 206 status code for object storage proxy 2022-12-19 16:08:00 +01:00
Chocobozzz
9b6c9b5ae6
Increase timeout 2022-12-12 16:16:27 +01:00
Chocobozzz
2732eeff9e
Fix CI using 127.0.0.1 for tests 2022-12-12 13:36:23 +01:00
Chocobozzz
c7c5f8d0f1
Add austrian sign language 2022-12-09 09:18:39 +01:00
Chocobozzz
c2fba93a60
Merge remote-tracking branch 'weblate/develop' into release/5.0.0 2022-12-07 09:00:49 +01:00
Chocobozzz
b6640fa0af
Add req and res to allow download filter hooks 2022-12-06 13:50:18 +01:00
Chocobozzz
b8598d40f6
Merge branch 'release/5.0.0' into develop 2022-12-02 17:54:23 +01:00
Chocobozzz
71e3e879c0
Support reinjecting token in private m3u8 playlist 2022-12-02 15:25:20 +01:00
Chocobozzz
190ac9df7c
Increase timeouts 2022-11-29 10:25:26 +01:00
Chocobozzz
5949eca71f
Increase old jobs to delete per hour 2022-11-28 15:16:15 +01:00
Chocobozzz
a5858c3e53
Update changelog 2022-11-24 13:36:32 +01:00
Chocobozzz
b7113ff7ef
Increase unicast job concurrency 2022-11-24 10:20:07 +01:00
Chocobozzz
624ea01b10
Fix overall viewers stats with start/end dates 2022-11-24 10:07:58 +01:00
Chocobozzz
c3b21b68b5
Delete completed/failed jobs directly from bullmq 2022-11-23 17:13:01 +01:00
Chocobozzz
5800f354cc
Filter out invalid images from peertube 2022-11-23 16:23:22 +01:00
Chocobozzz
3299c9e124
Add missing uuids search query doc 2022-11-23 15:50:42 +01:00
Chocobozzz
22926eafdb
Fix infohash exists memoize maxage
1 minute is enough, and it could lead to unknown infohash issue when
  re-streaming in a permanent live
2022-11-23 15:50:42 +01:00
Florent
fbad149ff2
Fix DISABLE_LOCAL_SEARCH blocking request to local search API (#5411) 2022-11-23 15:50:34 +01:00
Chocobozzz
b1dbb9fefc
Merge branch 'release/4.3.0' into develop 2022-11-16 14:40:34 +01:00
Chocobozzz
f240fb4bea
Fix broadcasting in parallel views 2022-11-16 14:40:10 +01:00
Chocobozzz
99b757488c
Fix server lint 2022-11-15 15:00:23 +01:00
Chocobozzz
4638cd713d
Don't inject untrusted input
Even if it's already checked in middlewares
It's better to have safe modals too
2022-11-15 14:41:55 +01:00
Chocobozzz
31a9ed960f
Add configuration for prometheus exporter hostname 2022-11-15 13:56:04 +01:00
Chocobozzz
077600e037
Upgrade server dependencies 2022-11-15 13:48:51 +01:00
Chocobozzz
c241947630
Correctly terminate an ended live 2022-11-15 10:50:57 +01:00
Chocobozzz
90dbc73132
Type result 2022-11-14 16:36:17 +01:00
kontrollanten
564b9b5597
refactor(server): redis > ioredis (#5371)
* refactor(server): redis > ioredis

* refactor(JobQueue): reuse redis connection builder

* fix(redisio)

* fix(redis): setValue

* feat(redis): showFriendlyErrorStack

* feat(redis): auto pipelining

308017a6b9/README.md (autopipelining)

* dont use autopipelining for bullmq

* ioredis events
2022-11-14 16:26:20 +01:00
Chocobozzz
ff91b644fb
Add ability to install alpha/beta/rc plugin 2022-11-14 16:21:59 +01:00
Chocobozzz
a742347d50
Fix transcoding test 2022-11-14 14:34:55 +01:00
Chocobozzz
f713f36bdf
Federate entire description
Introduce an explicit field truncatedDescription
description in video list is deprecated
description in video get will contain the entire description
2022-11-14 13:03:54 +01:00
Chocobozzz
44e702ded4
Prevent broken transcoding with audio only input 2022-11-14 11:39:01 +01:00
Chocobozzz
4efa5535cc
Fix infinite playlist import
Using an hard videos limit in config
2022-11-14 11:11:39 +01:00
Chocobozzz
f30ef8cf98
Fix retranscoding of odd resolution 2022-11-07 10:43:22 +01:00
Chocobozzz
c0a9de6652
Prevent uploadx too big log for config 2022-11-07 10:40:43 +01:00
Chocobozzz
a32bf8cd20
Fix running again transcoding on a video only file 2022-11-07 10:25:24 +01:00
Chocobozzz
11ae7e2917
Fix follow constraint check with an account 2022-11-07 10:11:51 +01:00
Chocobozzz
0015924ad6
Increase test timeout 2022-11-03 08:31:27 +01:00
Chocobozzz
5fc4a1825c
Fix preview generation for imports 2022-10-31 14:29:48 +01:00
Chocobozzz
6740b6428b
Fix transcoding failure when importing a video 2022-10-31 13:30:39 +01:00
Chocobozzz
e8299615c1
Fix CI 2022-10-31 09:55:09 +01:00
Chocobozzz
91c72729d8
Prevent error in redundancy scheduler 2022-10-31 08:57:52 +01:00
Chocobozzz
eb8da03d1c
Prevent error in update scheduler 2022-10-31 08:51:52 +01:00
Chocobozzz
c08e4cfcf9
Fix CLI build 2022-10-31 08:45:46 +01:00
Chocobozzz
9e5cf66be7
Breaking API: Consistency with role id/label 2022-10-28 16:34:08 +02:00
Chocobozzz
37ff5005b4
Add logger for uploadx 2022-10-28 10:47:06 +02:00
Chocobozzz
1b0a04dea8
Check missing config keys 2022-10-28 10:46:46 +02:00
Chocobozzz
1ebe2c2b9f
Update production.yaml 2022-10-28 09:59:39 +02:00
Chocobozzz
5a122dddc5
Option to disable static files auth check/s3 proxy 2022-10-27 09:13:10 +02:00
Chocobozzz
44df702502
More robust updateTorrentMetadata 2022-10-26 10:55:12 +02:00
Chocobozzz
e82cb08722
Fix proxy tests 2022-10-25 15:01:51 +02:00
Chocobozzz
aa887096f9
Correctly delete live files from object storage 2022-10-25 14:18:59 +02:00
Chocobozzz
508c1b1e9f
Correctly cleanup files from object storage 2022-10-25 11:51:20 +02:00
Chocobozzz
849f0fd3b2
Lock files to generate torrents/move files 2022-10-25 11:50:44 +02:00
Chocobozzz
3b1995a2d0
Increase test timeout 2022-10-24 14:54:21 +02:00
Chocobozzz
b3ce36069f Prevent concurrency issues when sending m3u8 file 2022-10-24 14:48:24 +02:00
Chocobozzz
0177101284 Fix tests 2022-10-24 14:48:24 +02:00
Chocobozzz
9ab330b90d Use private ACL for private videos in s3 2022-10-24 14:48:24 +02:00
Chocobozzz
3545e72c68 Put private videos under a specific subdirectory 2022-10-24 14:48:24 +02:00
kontrollanten
38a3ccc7f8
feat: show contained playlists under My videos (#5125)
* feat: show contained playlists under My videos

closes #4769

* refactor(server): remove unused types

* fixes after code review

* fix(client/video-miniature): add to playlist

* fix(server/user/me): shortUUID response

* Revert "fix(client/video-miniature): add to playlist"

This reverts commit f1a0412391.

* fix(client/PlaylistService): caching

* Revert "fix(server/user/me): shortUUID response"

This reverts commit e3f1ee4e33.

* Fix fetching playlists

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-24 14:48:03 +02:00
Chocobozzz
dd84f4f263
Wait segment sha processing 2022-10-11 17:14:54 +02:00
Alberto Mardegan
5e1bd8690b
server: use account/channel avatar in RSS feeds (#5325)
* server: use account/channel avatar in RSS feeds

Fixes: #5320

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-11 17:02:47 +02:00
Chocobozzz
bbae45c32e
Fix live tests 2022-10-11 16:00:11 +02:00
Chocobozzz
8bd6aa0424
Also retry when fetching master m3u8 playlist 2022-10-11 14:33:42 +02:00
Chocobozzz
e5fc6b5983
Fix host validation on locahost 2022-10-11 13:42:58 +02:00
Chocobozzz
cea2fd90dd
Merge branch 'release/4.3.0' into develop 2022-10-11 13:30:51 +02:00
Chocobozzz
a6b26afc56
Fix channel follow with manually approved follower 2022-10-11 13:27:22 +02:00
Chocobozzz
9d4c60dccc
Add ability for plugins to register ws routes 2022-10-11 11:11:04 +02:00
Chocobozzz
5cc2f0ea0a
Fix channel import with some channels 2022-10-10 15:33:32 +02:00
kontrollanten
c43ed8e862
Expose PeerTube socket to plugins (#5239)
* server(pluginHelpers): add socket

* test(plugins): add socket cases

* fixes after review

* Update plugin-helpers.ts

* Update plugin-helpers.ts
2022-10-10 15:18:31 +02:00
Chocobozzz
52d6c2e0bf
Fix video job error when video has been deleted 2022-10-10 14:51:11 +02:00
Chocobozzz
97a2a704e2
Fix peers info width in live 2022-10-10 11:44:47 +02:00
Chocobozzz
34aa316f58
Try to fix tests 2022-10-10 11:40:29 +02:00
Chocobozzz
63fa260a81
Merge branch 'feature/otp' into develop 2022-10-10 11:19:58 +02:00
Chocobozzz
a3e5f804ad
Encrypt OTP secret 2022-10-10 11:12:23 +02:00
Chocobozzz
2166c058f3
Allow admins to disable two factor auth 2022-10-07 14:28:35 +02:00
Chocobozzz
56f4783075
Support two factor authentication in backend 2022-10-07 10:51:16 +02:00
Chocobozzz
9b99d32804
Increase timeout 2022-10-04 14:57:11 +02:00
Chocobozzz
7dd7ff4ceb
Fix tests 2022-10-04 13:57:56 +02:00
Chocobozzz
e37ca6cbc7
Prevent error log 2022-10-04 11:17:37 +02:00
Chocobozzz
b7faa8372e
Decrease plugin version check for tests 2022-10-04 11:00:30 +02:00
kontrollanten
6c5f0d3aeb
server: serve files from storage/well-known (#5214)
* server: serve files from storage/well-known

closes #5206

* well-known: add tests

* test: try to skip new tests

* test: another try

* fix(config/prod): well_known path

* test: fix broken tests

* Update misc-endpoints.ts

* Use getDirectoryPath for tests

* Fix tests

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-10-04 10:53:00 +02:00
Chocobozzz
cfd57d2ca0
Live supports object storage
* Sync live files (segments, master playlist, resolution playlist,
   segment sha file) into object storage
 * Automatically delete them when the live ends
 * Segment sha file is now a file on disk, and not stored in memory
   anymore
2022-10-04 10:03:17 +02:00
Chocobozzz
c5f3ff39e5
Ask password reset/email verif error handling
With a user that uses a plugin authentication
2022-09-28 16:00:32 +02:00
Chocobozzz
43972ee466
Relax bitrate/fps test 2022-09-28 11:24:14 +02:00
Chocobozzz
0d6843decd
Merge branch 'release/4.3.0' into develop 2022-09-28 11:19:25 +02:00
Chocobozzz
1593e0dd5c
Add test for RTMP stream without audio 2022-09-28 11:19:08 +02:00
Chocobozzz
e15bc9dcd5
Merge branch 'release/4.3.0' into develop 2022-09-28 10:32:42 +02:00
Chocobozzz
1ce4256a65
Correctly handle RTMP streams without audio 2022-09-28 10:26:28 +02:00
Chocobozzz
49aa917509
Merge branch 'release/4.3.0' into develop 2022-09-28 10:03:32 +02:00
Chocobozzz
690bad52e1
Prevent "Cannot use same state" error 2022-09-28 10:03:06 +02:00
Chocobozzz
36305301cb
Set AKISMET_KEY as env 2022-09-28 08:25:46 +02:00
Chocobozzz
ca68986083
Merge branch 'release/4.3.0' into develop 2022-09-27 16:23:04 +02:00
Chocobozzz
2b32c5b37e
Fix InvalidVideoTitle console warning 2022-09-27 16:19:36 +02:00
Chocobozzz
97922ecf64
Handle sync failure in synchronizeChannel fn 2022-09-27 09:50:18 +02:00
Chocobozzz
3097acc7c2
Increase test timeout 2022-09-27 08:26:55 +02:00
Chocobozzz
84e7ff2757
Test akismet plugin signup 2022-09-26 16:27:06 +02:00
Chocobozzz
4f38148087
Add akismet tests 2022-09-23 15:38:21 +02:00
Chocobozzz
b2a70e3ca2
Support refusing remote comments 2022-09-23 11:38:18 +02:00
Chocobozzz
065684b2fe
Add sync youtube playlist test 2022-09-19 16:02:02 +02:00
Chocobozzz
e0bfb72ce0
Cleanup actor image without width 2022-09-16 14:56:12 +02:00
Chocobozzz
9a3a23a834
Fix onlyAfter comparison 2022-09-16 13:51:57 +02:00
Chocobozzz
3c4754a3a1
Wait transcoding by default when importing a video 2022-09-16 13:48:06 +02:00
Chocobozzz
8a6828b166
Check channel sync id is owned by channel 2022-09-16 10:58:13 +02:00
Chocobozzz
cbdd81da96
Fix import script 2022-09-16 09:52:50 +02:00
Chocobozzz
3204f4d17d
Fix sync import of latest videos 2022-09-16 09:37:07 +02:00
Chocobozzz
910744fb08
Improve VideoChannelSyncLatestScheduler logs 2022-09-14 15:10:37 +02:00
Chocobozzz
638949c67a
Increase test timeout 2022-09-14 13:39:36 +02:00
Chocobozzz
4404a7c467
Prevent job queue to be started before plugins 2022-09-14 11:45:18 +02:00
Chocobozzz
db312c7023
Fix old DB enum names 2022-09-13 15:22:02 +02:00
Chocobozzz
367a9dc699
Don't display remove file icon in some cases 2022-09-13 12:00:13 +02:00
Chocobozzz
aac7f4304d
Increase test timeout 2022-09-13 08:42:39 +02:00
Chocobozzz
31951badb3
Don't use hexa for av01 codec 2022-09-12 10:15:42 +02:00
Chocobozzz
0cbcaccb83
Increase test timeouts 2022-09-12 08:29:01 +02:00
Chocobozzz
01ec3975e0
Fix level for AV1 2022-09-09 15:02:28 +02:00
Chocobozzz
ec8c188b14
Update client dep 2022-09-09 14:59:09 +02:00
Chocobozzz
d9dd51aec7
Try playlist rebuild transaction if needed 2022-09-09 12:05:57 +02:00
Chocobozzz
edacb64033
Don't use safe mode when normalizing 2022-09-09 11:46:58 +02:00
Chocobozzz
8409160821
Fix context 2022-09-09 11:33:06 +02:00
Chocobozzz
3d2e4f0371
Update server dependencies 2022-09-09 11:11:52 +02:00
Chocobozzz
e4fc3697ac
Fix saved live master playlist bandwidth 2022-09-09 09:21:42 +02:00
Chocobozzz
405c83f9af
Use worker thread to send HTTP requests
Compute HTTP signature could be CPU intensive
2022-09-08 12:27:22 +02:00
Chocobozzz
6c4d6ec831
Prevent compat issue with old username
We were accepting more characters, so don't break DB for these users
2022-09-08 10:45:05 +02:00
q_h
23c0b67d7b
fix: validate s3 response (#5231)
* refactor:  remove `objectStoragePut`

this is already implemented in `lib-storage`

* fix:  validate s3 response

* fix:  enable built-in retries

* chore: add `leavePartsOnError` comment

* refactor: decrease partSize to speed up retries

* refactor: rethrow s3 errors

* refactor: reduce max_upload_part  default to 100MB

* refactor: validate response

* chore: add link to explanation
2022-09-08 08:54:12 +02:00
Chocobozzz
e9fc9e03c1
Optimize fetching playlist urls 2022-09-08 08:41:48 +02:00
Chocobozzz
d4d9bbc6f2
Fix channel sync right check 2022-09-08 08:41:48 +02:00
Chocobozzz
6c38f40d96
Prevent weird error on sync failure 2022-09-08 08:41:48 +02:00
Chocobozzz
ea139ca870
Display error on youtube-dl get info failure 2022-08-18 11:40:07 +02:00
Chocobozzz
e5d771a390
Correctly fix feeds tests 2022-08-17 16:22:25 +02:00
Chocobozzz
479b269631
Fix feeds tests 2022-08-17 16:14:15 +02:00
Chocobozzz
863477173e
Cleanup tests imports 2022-08-17 15:47:54 +02:00
Chocobozzz
e0faa8ad6e
We don't need to import mocha 2022-08-17 15:40:57 +02:00
Chocobozzz
690bb8f9f3
Prefer using Object.values 2022-08-17 15:36:03 +02:00
Chocobozzz
bbd5aa7ead
Reimplement a typed omit function 2022-08-17 15:25:58 +02:00
Chocobozzz
a85d530384
Remove unnecessary logs 2022-08-17 14:58:40 +02:00
Chocobozzz
2ec349aa85
Prefer using our pick function 2022-08-17 14:54:01 +02:00
Chocobozzz
396f6f0140
Cleanup useless express validator messages 2022-08-17 14:27:04 +02:00
Chocobozzz
0b684daa3d
Add videoUUID to playback metrics 2022-08-17 10:21:38 +02:00
Chocobozzz
7804e577de
Increase test timeout 2022-08-16 15:41:21 +02:00
Chocobozzz
70c6a848a4
Fix tests 2022-08-16 14:03:09 +02:00
Chocobozzz
3b2006bb72
Increase timeouts 2022-08-16 10:33:27 +02:00
Chocobozzz
fd3c2e8705
Add playback metric endpoint sent to OTEL 2022-08-16 10:33:27 +02:00
Chocobozzz
0e6cd1c00f
Add ability to list comments on local videos 2022-08-16 10:33:27 +02:00
Chocobozzz
2a95b88477
Add spans for AP signature checkers 2022-08-11 14:10:18 +02:00
Chocobozzz
ab08ab4e28
Don't crash on redis connection error 2022-08-11 11:30:06 +02:00
Chocobozzz
b1053a30f6
Add ability to use docker on local 2022-08-11 10:43:31 +02:00
Chocobozzz
f4057afd20
Fix live tests 2022-08-11 09:56:17 +02:00
Chocobozzz
4fd6dcfb44
Fix transcoding of quad audio channels 2022-08-10 16:05:38 +02:00
Chocobozzz
0cfc8c4fe4
Fix test 2022-08-10 16:01:59 +02:00
Chocobozzz
a3b472a12e
Add ability to list imports of a channel sync 2022-08-10 14:32:00 +02:00
Florent
2a491182e4
Channel sync (#5135)
* Add external channel URL for channel update / creation (#754)

* Disallow synchronisation if user has no video quota (#754)

* More constraints serverside (#754)

* Disable sync if server configuration does not allow HTTP import (#754)

* Working version synchronizing videos with a job (#754)

TODO: refactoring, too much code duplication

* More logs and try/catch (#754)

* Fix eslint error (#754)

* WIP: support synchronization time change (#754)

* New frontend #754

* WIP: Create sync front (#754)

* Enhance UI, sync creation form (#754)

* Warning message when HTTP upload is disallowed

* More consistent names (#754)

* Binding Front with API (#754)

* Add a /me API (#754)

* Improve list UI (#754)

* Implement creation and deletion routes (#754)

* Lint (#754)

* Lint again (#754)

* WIP: UI for triggering import existing videos (#754)

* Implement jobs for syncing and importing channels

* Don't sync videos before sync creation + avoid concurrency issue (#754)

* Cleanup (#754)

* Cleanup: OpenAPI + API rework (#754)

* Remove dead code (#754)

* Eslint (#754)

* Revert the mess with whitespaces in constants.ts (#754)

* Some fixes after rebase (#754)

* Several fixes after PR remarks (#754)

* Front + API: Rename video-channels-sync to video-channel-syncs (#754)

* Allow enabling channel sync through UI (#754)

* getChannelInfo (#754)

* Minor fixes: openapi + model + sql (#754)

* Simplified API validators (#754)

* Rename MChannelSync to MChannelSyncChannel (#754)

* Add command for VideoChannelSync (#754)

* Use synchronization.enabled config (#754)

* Check parameters test + some fixes (#754)

* Fix conflict mistake (#754)

* Restrict access to video channel sync list API (#754)

* Start adding unit test for synchronization (#754)

* Continue testing (#754)

* Tests finished + convertion of job to scheduler (#754)

* Add lastSyncAt field (#754)

* Fix externalRemoteUrl sort + creation date not well formatted (#754)

* Small fix (#754)

* Factorize addYoutubeDLImport and buildVideo (#754)

* Check duplicates on channel not on users (#754)

* factorize thumbnail generation (#754)

* Fetch error should return status 400 (#754)

* Separate video-channel-import and video-channel-sync-latest (#754)

* Bump DB migration version after rebase (#754)

* Prettier states in UI table (#754)

* Add DefaultScope in VideoChannelSyncModel (#754)

* Fix audit logs (#754)

* Ensure user can upload when importing channel + minor fixes (#754)

* Mark synchronization as failed on exception + typos (#754)

* Change REST API for importing videos into channel (#754)

* Add option for fully synchronize a chnanel (#754)

* Return a whole sync object on creation to avoid tricks in Front (#754)

* Various remarks (#754)

* Single quotes by default (#754)

* Rename synchronization to video_channel_synchronization

* Add check.latest_videos_count and max_per_user options (#754)

* Better channel rendering in list #754

* Allow sorting with channel name and state (#754)

* Add missing tests for channel imports (#754)

* Prefer using a parent job for channel sync

* Styling

* Client styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-08-10 09:53:39 +02:00
Chocobozzz
06ac128958
Fix print transcode command test 2022-08-09 14:49:25 +02:00
Chocobozzz
7f529402d1
Fix live max rate 2022-08-09 13:59:51 +02:00
Chocobozzz
51335c72cf
Prevent job failure on concurrent HLS transcoding 2022-08-09 13:21:18 +02:00
Chocobozzz
e2b2c726b1
Fix job queue tests 2022-08-09 11:39:31 +02:00
Chocobozzz
cfb5edbd9e
Increase logs stack trace max size 2022-08-09 11:34:56 +02:00
Chocobozzz
c543e41492
Increate test timeout 2022-08-09 11:24:08 +02:00
Chocobozzz
e13db048c7
Fix upload notification 2022-08-09 11:22:29 +02:00
Chocobozzz
8d33235de7
Remove unused log 2022-08-09 11:13:01 +02:00
Chocobozzz
b42c2c7e89
Avoid concurrency issue on transcoding 2022-08-09 09:32:17 +02:00
Chocobozzz
bd911b54b5
Use bullmq job dependency 2022-08-09 09:18:07 +02:00
Chocobozzz
5a921e7b74
Move to bullmq 2022-08-09 09:18:07 +02:00
Chocobozzz
5e2afe4290
Limit import depending on transcoding resolutions 2022-08-09 09:18:07 +02:00
Chocobozzz
64fd6158fd
Fix resolution to transcode hook name 2022-08-09 09:18:07 +02:00
Chocobozzz
84cae54e7a
Add option to not transcode original resolution 2022-08-09 09:18:07 +02:00
Florent
7e0f50d6e0 Use single quotes in server/ and update eslint rules 2022-08-08 08:25:36 +02:00
Florent
b37d80e3ce Fix lint on hls.ts 2022-08-04 09:49:26 +02:00
Chocobozzz
9427890798
Add more tests for plugin rebuild 2022-08-03 15:16:56 +02:00
Chocobozzz
c795e19663
Automatically rebuild native modules on ABI change 2022-08-03 15:08:36 +02:00
Chocobozzz
fd59208e8c
Fix lint 2022-08-03 11:54:08 +02:00
Chocobozzz
84992f5606
Fix tests 2022-08-03 11:49:39 +02:00
Chocobozzz
785f1897a4
Add notification plugin hook 2022-08-03 11:33:43 +02:00
Chocobozzz
0260dc8aca
Add channel server hooks 2022-08-03 11:24:42 +02:00
Chocobozzz
0b6f531653
Suffix external auth username on conflict 2022-08-03 10:10:26 +02:00
Chocobozzz
35a0a92483
Use same mastodon regex for usernames 2022-08-03 10:09:29 +02:00
Chocobozzz
f59462eca4
Fix tests 2022-08-02 16:15:37 +02:00
Chocobozzz
ebb9e53ada
Add plugin hook on transcoding resolutions building 2022-08-02 16:05:44 +02:00
Chocobozzz
22df69fdec
Add job queue hooks 2022-08-02 15:50:05 +02:00
Chocobozzz
7a9e420a02
Remove uneeded async 2022-08-02 14:41:44 +02:00
Chocobozzz
ec240986ef
Increase timeouts 2022-08-01 16:05:41 +02:00
Chocobozzz
15eb9e5b8f
Fix typescript error 2022-08-01 15:27:49 +02:00
Chocobozzz
1bb4c9ab2e
Add ability to delete a specific video file 2022-08-01 14:55:10 +02:00
Chocobozzz
12d84abeca
Include video file id in API 2022-07-29 11:33:27 +02:00
Chocobozzz
5a9a56b78f
Prevent error on highlighted thread 2022-07-29 10:32:56 +02:00
Chocobozzz
ce6b3765a2
Add more tracing 2022-07-28 10:56:05 +02:00
Chocobozzz
adc94cf09c
Add live and viewers otel metrics 2022-07-27 16:19:25 +02:00
Chocobozzz
50cc1ee48a
Fix process follow 2022-07-27 15:45:04 +02:00
Chocobozzz
eb7b48ce84
Prevent logging an error on lazy static 404 2022-07-27 14:38:07 +02:00
Chocobozzz
e3d6c6434f
Add bulk action on following/followers 2022-07-27 13:52:13 +02:00
Chocobozzz
073deef886
Handle rejected follows in client
Also add quick filters so it's easier to find pending follows
2022-07-27 13:52:13 +02:00
Chocobozzz
927fa4b11f
Add rejected state to follows
Prevent reprocessing already rejected follows
2022-07-27 13:52:13 +02:00
Chocobozzz
0f58b11f5c
Reduce joins need to generate AP url 2022-07-27 13:52:13 +02:00
Florent
3efa4da1fe Fix password for root in dev mode
password should remain "test" in dev mode for root.
Fix regression of 9452d4fd33 which introduces NODE_ENV=dev
2022-07-26 10:00:17 +02:00
Chocobozzz
9e2a4af3a0
Use unique AP id for accept/reject 2022-07-25 11:24:05 +02:00
Chocobozzz
7b6b445d91
Regenerate video filenames on transcoding
In particular when using manual transcoding, to invalidate potential
HTTP caches in front of peertube
2022-07-25 10:57:16 +02:00
Chocobozzz
4f50475c67
Display latest uploaded date for captions 2022-07-25 10:45:40 +02:00
Chocobozzz
c8fa571f32
Clearer live session
Get the save replay setting when the session started to prevent
inconsistent behaviour when the setting changed before the session was
processed by the live ending job

Display more information about the potential session replay in live
modal information
2022-07-22 15:22:21 +02:00
Chocobozzz
7fd28c99b9
Fix lint 2022-07-19 15:34:44 +02:00
Chocobozzz
cd1b8e9a40
Add node process metrics 2022-07-19 11:58:19 +02:00
Chocobozzz
0755cb89e7
Prevent logging error when saving delete live 2022-07-18 15:49:15 +02:00
Chocobozzz
cace0d1a71
Prevent headers sent error 2022-07-18 15:41:47 +02:00
Chocobozzz
58c44687f7
Fix my videos counter 2022-07-18 14:53:50 +02:00
Chocobozzz
1efad362ef
Display a warning if using ffmpeg 4.4.0 2022-07-18 14:53:20 +02:00
Chocobozzz
1cc9774668
Fix incorrect error logs 2022-07-18 11:55:13 +02:00
Chocobozzz
42b4063699
Add ability for client to create server logs 2022-07-18 11:37:18 +02:00
Chocobozzz
654d4ede7f
Correctly handle actors without follow counters 2022-07-15 11:18:29 +02:00
Chocobozzz
319f9670bf
Fix invalid http signature
Date header could be inconsistent with the date included in the
signature
2022-07-15 11:06:27 +02:00
Chocobozzz
2939925639
Fix live tests 2022-07-13 15:37:36 +02:00
Chocobozzz
ba2684cedd
Fix lint 2022-07-13 12:14:26 +02:00
Chocobozzz
da5f46487f
Fix plugin filter test 2022-07-13 11:26:00 +02:00
Chocobozzz
f7ce623db1
Don't log error on static 404 2022-07-13 11:21:19 +02:00
Chocobozzz
ea8107bff8
Split static router 2022-07-13 11:16:29 +02:00
Chocobozzz
c5cadb2859
Reduce unknown undo logging level 2022-07-13 11:07:01 +02:00
Chocobozzz
8ab98cfb61
Prevent 500 in AP clietn 2022-07-13 11:03:07 +02:00
Chocobozzz
e0f49a19ea
Reduce db retry log on failure 2022-07-13 10:59:55 +02:00
Chocobozzz
39d117a47d
Prevent error logs when aborting a stream 2022-07-13 10:57:04 +02:00
Chocobozzz
14f7ad399f
Add more error logs 2022-07-13 10:17:47 +02:00
Chocobozzz
3b0525106d
Prevent duplicated HLS playlist on transcoding 2022-07-13 10:15:41 +02:00
Chocobozzz
b0f4204266
Relax log level
401 is expected when the token has expired
federation issues are not very important
2022-07-13 10:04:22 +02:00
Chocobozzz
3d401c1b3d
Correctly set mp3 codec string in hls playlist 2022-07-13 08:42:07 +02:00
Chocobozzz
eaaf316fe1
Don't display errors when SMTP is not configured
info is enough
2022-07-12 16:32:05 +02:00
Chocobozzz
46f7cd6837
Fix handling broken lives
We want the latest session that may already be finished
2022-07-12 16:30:59 +02:00
Chocobozzz
4ddb53f65d
Auto retry video state db query on failure 2022-07-12 16:25:21 +02:00
Chocobozzz
f686f5ed0a
Fix audio file merge
Image streams are considered as video streams by ffmpeg
Filter out image codec name
2022-07-12 16:00:15 +02:00
Chocobozzz
5d7cb63ede
Add compat with openssl 3 2022-07-12 12:08:12 +02:00
Chocobozzz
a49407524f
Prevent invalid watch sections 2022-07-12 09:51:21 +02:00
Chocobozzz
f614635d6a
Fix unknown infohash setting 2022-07-11 14:37:58 +02:00
Chocobozzz
6504b3bfd9
Fix videos stats 2022-07-08 11:51:41 +02:00
Chocobozzz
17d85f48b5
Fix unknown infohash skip log 2022-07-06 16:19:08 +02:00
Chocobozzz
9452d4fd33
/!\ Use a dedicated config file for development
It means you have to replace NODE_ENV=test to NODE_ENV=dev if you use it
npm run dev:* commands are already updated
2022-07-06 16:12:17 +02:00
Chocobozzz
630d0a1bf5
Introduce experimental telemetry 2022-07-06 15:13:55 +02:00
Chocobozzz
15b43b214e
Increase test timeout 2022-07-04 13:34:03 +02:00
Chocobozzz
cd25344f74
Reduce lazy static error logs 2022-06-30 09:25:17 +02:00
Chocobozzz
a4152bed14
Add ability to disable unknown infohash log 2022-06-30 09:13:11 +02:00
Chocobozzz
031bbcd25d
Upgrade oauth2-server 2022-06-28 15:32:57 +02:00
Chocobozzz
4fae2b1f30
Rename video full loading 2022-06-28 15:06:15 +02:00
Chocobozzz
daa0226b0a
Lazy load piscina 2022-06-28 09:09:03 +02:00
Chocobozzz
ccd62a4502
Fix workers constants 2022-06-27 15:56:57 +02:00
Chocobozzz
3a54605d4e
Process images in a dedicated worker 2022-06-27 11:53:12 +02:00
Chocobozzz
e722fb5923
Merge branch 'release/4.2.0' into develop 2022-06-27 10:36:31 +02:00
Chocobozzz
41e74ec9cd
Fix broken feeds with published live 2022-06-27 10:36:16 +02:00
Chocobozzz
7a5c3d77fe
Fix feed with live stream 2022-06-27 10:20:49 +02:00
Chocobozzz
7fb45bdacb
Optimize feeds query 2022-06-27 09:34:26 +02:00
Chocobozzz
c53853ca1b
Introduce worker threads to process remote images 2022-06-24 16:31:48 +02:00
Chocobozzz
978489b64c
Add toki pona in video languages 2022-06-24 11:59:12 +02:00
Chocobozzz
4e56f0fff1
Merge branch 'release/4.2.0' into develop 2022-06-24 10:33:26 +02:00
Chocobozzz
c3fb12b31f
Fix lint 2022-06-24 10:13:09 +02:00
Chocobozzz
92083e4228
Fix removed sha segments on fast restream 2022-06-24 09:57:55 +02:00
Chocobozzz
b6e2b5df73
Fix removed sha segments on fast restream 2022-06-24 09:35:30 +02:00
Chocobozzz
371d4c6063
Merge branch 'release/4.2.0' into develop 2022-06-23 11:01:55 +02:00
Chocobozzz
f2623febd8
Fix duplicated tags error 2022-06-23 11:01:44 +02:00
Chocobozzz
64324ac646
Merge branch 'release/4.2.0' into develop 2022-06-23 10:53:16 +02:00
Chocobozzz
20886f4bf9
Fix search index tests 2022-06-23 10:31:17 +02:00
Chocobozzz
53023be33a
Fix fast restream in saved permanent live 2022-06-23 10:30:48 +02:00
Chocobozzz
2c2befaaca
Fix video right check 2022-06-22 14:03:50 +02:00
Chocobozzz
ff9d43f62a
Refactor video rights checker 2022-06-22 10:25:31 +02:00
kontrollanten
2e401e8575
store uploaded video filename (#4885)
* store uploaded video filename

closes #4731

* dont crash if videos channel exist

* migration: use raw query

* video source: fixes after code review

* cleanup

* bump migration

* updates after code review

* refactor: use checkUserCanManageVideo

* videoSource: add openapi doc

* test(check-params/video-source): fix timeout

* Styling

* Correctly set original filename as source

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-06-21 15:31:25 +02:00
Durgaraj Karki
c8bac5396c
fixes video not played from defined parameters in embed service (#5023)
* fixes video not played from defined parameters in embed service

* adds parameters to the oembed services

* Styling

Co-authored-by: Chocobozzz <me@florianbigard.com>
2022-06-21 14:38:15 +02:00
Chocobozzz
a91e9beb3f
Update server dependencies 2022-06-21 11:23:32 +02:00
Chocobozzz
2b621ac0eb
Merge branch 'release/4.2.0' into develop 2022-06-21 09:03:20 +02:00
Chocobozzz
8633ad22a7
Fix AP element with deleted video federation 2022-06-21 08:59:46 +02:00
Chocobozzz
0f07c28951
Correctly handle unknown remote actor image size 2022-06-20 11:48:40 +02:00
Chocobozzz
714e33a742
Merge branch 'release/4.2.0' into develop 2022-06-20 10:23:19 +02:00
Chocobozzz
f53e1fcd99
Relax views federation 2022-06-20 10:04:52 +02:00