228 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
dave	339f89522a	fix missing wait param	2025-03-20 12:19:00 -07:00
dave	4037ed05cf	job based thumb generation working, for stills	2025-03-19 20:34:55 -07:00
dave	90da25eddb	thumb generation frontend and http plugin	2025-03-18 18:37:17 -07:00
dave	8fcf5f6e28	job-based thumb generation plugin skeleton	2025-03-17 19:41:38 -07:00
dave	0f5ae04644	accept job args	2025-03-12 19:27:04 -07:00
dave	0d4037dccd	job retrying	2025-03-11 13:44:03 -07:00
dave	2bc8f88b1e	dead job scan progress	2025-03-10 16:07:45 -07:00
dave	f1b1265366	preliminary job retry function. This will retry enqueuing jobs into redis, handling the case of initial insert failing or redis losing data	2025-03-09 22:00:42 -07:00
dave	66b4cc8101	rqlite: add has_job function to determine if redis has a job, and require the user to specify a job ID	2025-03-08 20:11:58 -08:00
dave	b74de1fed1	jobs monitoring process - will re-queue jobs that appear to have fallen off	2025-03-07 16:34:26 -08:00
dave	fd3b8d90d9	fix job name generation, the target column was actually for the func name	2025-03-06 17:45:59 -08:00
dave	2ac0c350b6	remove unique constraint on job name column. The job_name column is to be used to store the function name for the job, such as generate_thumbs ... also, add a last_updated column to the jobs table. This column will be null until a job starts, at which point it will contain a heartbeat timestamp. Jobs may use this field for determining if a job has failed or timed out and needs to be re-ran	2025-03-04 19:43:53 -08:00
dave	a50e1a6830	move jobserver setup to own function	2025-03-03 20:32:28 -08:00
dave	2f6a994118	skeleton for job retrying method	2025-03-02 17:14:35 -08:00
dave	35ea66a712	add option for integrated jobserver	2025-03-01 21:11:35 -08:00
dave	bff7833230	add ability to run jobserver as separate process	2025-02-28 18:34:12 -08:00
dave	d5f34256b2	use redis pool instead of direct connection	2025-02-27 11:57:20 -08:00
dave	1c0b8b7c02	move job funcs to separate file and begin example job function	2025-02-25 18:43:55 -08:00
dave	b70319bacb	job context for passing db connection to jobs ... TODO consider having RedisJobServer hold references to the sql client, redis client, etc, as this would avoid having to re-eastablish connections on each job - unless the jobs functions can use some sort of cache? Or, would require making the job functions class methds on the RedisJobServer	2025-02-26 22:45:39 -08:00
dave	f99e3ade8b	fix uuid calling	2025-02-23 15:55:12 -08:00
dave	77c3991ec8	status generation	2025-02-20 23:01:27 -08:00
dave	5fde636687	vague semblance of working	2025-02-19 14:04:38 -08:00
dave	3cd10abd9e	begin refactoring for redis based jobs system	2025-02-18 18:29:16 -08:00
dave	b89d1505e1	add consumerwatch	2025-02-17 13:36:34 -08:00
dave	d57a8856d9	rqlite do/work	2025-02-16 13:58:48 -08:00
dave	540aab8ff3	redis job framework skeleton	2025-02-18 15:23:30 -08:00
dave	8dbeae3f9f	jobs ui testing	2025-02-18 15:23:30 -08:00
dave	8b978b4f4d	basic job status ui	2025-02-18 15:23:30 -08:00
dave	2d45f93d34	job docs and cleanup	2025-02-18 15:23:30 -08:00
dave	b824702d23	simple job loop	2025-02-18 15:23:30 -08:00
dave	a5afe3376a	use scoped sessions	2025-02-18 15:23:30 -08:00
dave	c0911d3614	job executor progress	2025-02-18 15:23:30 -08:00
dave	e9e3083e43	refactor jobs a bit and plan out the basic executor	2025-02-18 15:23:30 -08:00
dave	81cc72732c	password change function	2025-02-18 15:23:30 -08:00
dave	508fa6d585	job server planning	2025-02-18 15:23:30 -08:00
dave	3e8a6e0da5	more jobs progress	2025-02-18 15:23:30 -08:00
dave	c4a6f8f217	start handling jobs	2025-02-18 15:23:30 -08:00
dave	600b2b0b4f	run a job executor in the daemon for testing	2025-02-18 15:23:30 -08:00
dave	eaad333996	base job executor framing	2025-02-18 15:23:30 -08:00
dave	c27220dc62	JobTargetStatus as a means of tracking job progress	2025-02-18 15:23:30 -08:00
dave	0850a4c26f	use JobSubscriber as the "thick" jobs client and keep JobsClient as low level	2025-02-18 15:23:30 -08:00
dave	af7f86cd93	refactor setup_webapp so that it only does webapp setup stuff	2025-02-18 15:23:30 -08:00
dave	a038aa24a9	add database query debugging option	2025-02-18 15:23:30 -08:00
dave	88c774efff	vague jobs client / api architecture	2025-02-18 15:23:30 -08:00
dave	1e93467191	misc jobs progress	2025-02-18 15:23:30 -08:00
dave	6391ffb860	fix thumb service url	2025-02-07 14:45:27 -08:00
dave	d673c01ec4	add pod disruption budget	2025-02-04 15:09:21 -08:00
dave	472d93a800	search by rating	2025-02-02 20:16:57 -08:00
dave	e939b334dd	fix missing magic	2025-01-29 11:39:39 -08:00
dave	9bf63d9581	tiny up TODO list	2024-12-25 20:09:30 -05:00