Commit Graph

  • 6af91a1f07 add integration test harness master dave 2025-04-18 10:30:16 -07:00
  • 58971a8f76 remove unused thumbservice variable dave 2025-04-17 22:28:52 -07:00
  • 95c4a3feaf add cherrypy tests dave 2025-04-16 19:21:51 -07:00
  • 73c2a6654b fix cherrypy tests dave 2025-04-15 14:30:26 -07:00
  • d408c8349a remove long-broken old ingest script dave 2025-04-14 21:02:50 -07:00
  • f782e560c3 add makefile dave 2025-04-13 11:17:27 -07:00
  • c8734cb81c Merge pull request 'image processing job subsystem' (#7) from jobs into master dave 2025-04-12 23:39:42 -07:00
  • 053aa3334b Merge branch 'master' into jobs jobs dave 2025-04-12 23:22:27 -07:00
  • 88ab7eeabc rarely used in-process image resizing func needs to return true on success dave 2025-04-12 21:38:07 -07:00
  • 7f0c991508 update terraform, adding redis dave 2025-04-11 17:10:32 -07:00
  • 67c421bc00 fix s3-based files not supporting context management dave 2025-04-10 10:41:44 -07:00
  • c723a0f3ad fix rqlite result listener always reading from position 0, which caused infinite looping waiting for job results in some situations dave 2025-04-09 22:47:55 -07:00
  • fb2624264c fix stupid print->logging errors dave 2025-04-08 15:18:12 -07:00
  • bfe608fdc6 split out terraform files dave 2025-04-07 20:38:48 -07:00
  • 9bf157623b clean up prints to logging dave 2025-04-06 21:34:44 -07:00
  • db253e1488 link minimap to google maps dave 2025-04-04 15:03:20 -07:00
  • f52072c8c3 add debug cli dave 2025-04-03 19:19:35 -07:00
  • e1a336e94c clean up redis when done retrying jobs dave 2025-04-02 18:38:05 -07:00
  • 8597d6abbd job retrying dave 2025-04-01 21:29:02 -07:00
  • 5e215fe8e0 replace has_job with last_status dave 2025-03-31 19:44:56 -07:00
  • e35d7991b9 write errors to result stream dave 2025-03-30 17:17:41 -07:00
  • eb860184dc use longer result stream expiration dave 2025-03-29 14:38:56 -07:00
  • 6761397722 push message to job results stream indicating when the job starts dave 2025-03-27 22:36:59 -07:00
  • ab5792445f use redis lock to avoid running multiple RedisJobMonitors dave 2025-03-26 22:57:23 -07:00
  • 82be08b0ba add consumer flushing to jobs server dave 2025-03-25 20:21:46 -07:00
  • 413496eaae remove thumbserver dave 2025-03-24 19:42:40 -07:00
  • fa796b60d3 remove thumbtool/thumbserver dave 2025-03-24 19:40:35 -07:00
  • 9dd419d4c7 closing cleanup dave 2025-03-23 20:24:26 -07:00
  • 72b98949ec wait fix dave 2025-03-22 23:03:44 -07:00
  • fdf1e9804f video thumbnail generation via job system dave 2025-03-21 14:48:10 -07:00
  • 339f89522a fix missing wait param dave 2025-03-20 12:19:00 -07:00
  • 4037ed05cf job based thumb generation working, for stills dave 2025-03-19 20:34:55 -07:00
  • 90da25eddb thumb generation frontend and http plugin dave 2025-03-18 18:37:17 -07:00
  • 8fcf5f6e28 job-based thumb generation plugin skeleton dave 2025-03-17 19:41:38 -07:00
  • 0f5ae04644 accept job args dave 2025-03-12 19:27:04 -07:00
  • 0d4037dccd job retrying dave 2025-03-11 13:44:03 -07:00
  • 2bc8f88b1e dead job scan progress dave 2025-03-10 16:07:45 -07:00
  • f1b1265366 preliminary job retry function. This will retry enqueuing jobs into redis, handling the case of initial insert failing or redis losing data dave 2025-03-09 22:00:42 -07:00
  • 66b4cc8101 rqlite: add has_job function to determine if redis has a job, and require the user to specify a job ID dave 2025-03-08 20:11:58 -08:00
  • b74de1fed1 jobs monitoring process - will re-queue jobs that appear to have fallen off dave 2025-03-07 16:34:26 -08:00
  • fd3b8d90d9 fix job name generation, the target column was actually for the func name dave 2025-03-06 17:45:59 -08:00
  • 2ac0c350b6 remove unique constraint on job name column. The job_name column is to be used to store the function name for the job, such as generate_thumbs also, add a last_updated column to the jobs table. This column will be null until a job starts, at which point it will contain a heartbeat timestamp. Jobs may use this field for determining if a job has failed or timed out and needs to be re-ran dave 2025-03-04 19:43:53 -08:00
  • a50e1a6830 move jobserver setup to own function dave 2025-03-03 20:32:28 -08:00
  • 2f6a994118 skeleton for job retrying method dave 2025-03-02 17:14:35 -08:00
  • 35ea66a712 add option for integrated jobserver dave 2025-03-01 21:11:35 -08:00
  • bff7833230 add ability to run jobserver as separate process dave 2025-02-28 18:34:12 -08:00
  • d5f34256b2 use redis pool instead of direct connection dave 2025-02-27 11:57:20 -08:00
  • 1c0b8b7c02 move job funcs to separate file and begin example job function dave 2025-02-25 18:43:55 -08:00
  • b70319bacb job context for passing db connection to jobs dave 2025-02-24 18:26:04 -08:00
  • f99e3ade8b fix uuid calling dave 2025-02-23 15:55:12 -08:00
  • 77c3991ec8 status generation dave 2025-02-20 23:01:27 -08:00
  • 5fde636687 vague semblance of working dave 2025-02-19 14:04:38 -08:00
  • 3cd10abd9e begin refactoring for redis based jobs system dave 2025-02-18 18:29:16 -08:00
  • b89d1505e1 add consumerwatch dave 2025-02-17 13:36:34 -08:00
  • d57a8856d9 rqlite do/work dave 2025-02-15 16:03:39 -08:00
  • 540aab8ff3 redis job framework skeleton dave 2025-02-15 16:03:39 -08:00
  • 8dbeae3f9f jobs ui testing dave 2023-07-07 23:08:28 -07:00
  • 8b978b4f4d basic job status ui dave 2023-07-06 22:36:05 -07:00
  • 2d45f93d34 job docs and cleanup dave 2023-07-05 23:29:15 -07:00
  • b824702d23 simple job loop dave 2023-07-05 22:36:26 -07:00
  • a5afe3376a use scoped sessions dave 2023-07-05 22:35:10 -07:00
  • c0911d3614 job executor progress dave 2023-06-28 23:24:58 -07:00
  • e9e3083e43 refactor jobs a bit and plan out the basic executor dave 2023-06-27 22:48:14 -07:00
  • 81cc72732c password change function dave 2023-06-26 23:39:03 -07:00
  • 508fa6d585 job server planning dave 2023-02-02 22:37:51 -08:00
  • 3e8a6e0da5 more jobs progress dave 2023-02-01 23:04:42 -08:00
  • c4a6f8f217 start handling jobs dave 2023-01-31 22:58:26 -08:00
  • 600b2b0b4f run a job executor in the daemon for testing dave 2023-01-31 09:24:23 -08:00
  • eaad333996 base job executor framing dave 2023-01-30 22:07:16 -08:00
  • c27220dc62 JobTargetStatus as a means of tracking job progress dave 2023-01-30 22:06:08 -08:00
  • 0850a4c26f use JobSubscriber as the "thick" jobs client and keep JobsClient as low level dave 2023-01-30 22:03:23 -08:00
  • af7f86cd93 refactor setup_webapp so that it only does webapp setup stuff dave 2023-01-30 21:58:54 -08:00
  • a038aa24a9 add database query debugging option dave 2023-01-23 22:23:27 -08:00
  • 88c774efff vague jobs client / api architecture dave 2023-01-20 20:58:47 -08:00
  • 1e93467191 misc jobs progress dave 2023-01-12 22:58:33 -08:00
  • 6391ffb860 fix thumb service url dave 2025-02-07 14:45:27 -08:00
  • d673c01ec4 add pod disruption budget dave 2025-02-04 15:09:21 -08:00
  • 472d93a800 search by rating dave 2025-02-02 20:16:57 -08:00
  • e939b334dd fix missing magic dave 2025-01-29 11:39:39 -08:00
  • 9bf63d9581 tiny up TODO list star-ratings dave 2024-11-15 23:10:29 -05:00
  • e360b3be3a hide remove-rating-button when there is no rating dave 2024-11-14 18:56:55 -05:00
  • 564a627a39 photo rating backend dave 2024-11-13 16:47:08 -05:00
  • eefd5bdbce add rating on photo pages dave 2024-11-12 20:28:23 -05:00
  • bb562d88d7 add rating db cols and internals dave 2024-11-11 14:03:22 -05:00
  • 5cb17130db fix duplicate uid dave 2024-11-10 09:37:53 -05:00
  • 4800d4a94e update build to noble, python 3.13, and node 20 lts dave 2024-11-09 15:05:26 -05:00
  • 808c92e9b8 update deps for python3.13 dave 2024-12-25 11:42:29 -05:00
  • aab7246f85 add env var to override cli config location dave 2024-11-08 13:59:06 -05:00
  • 664bc23006 update install steps and some planned feature notes dave 2024-11-07 07:45:55 -05:00
  • 7ddb2b933c add args arg dave 2024-04-05 12:57:31 -07:00
  • 2e588149be updates for tf 1.5 dave 2024-04-04 15:51:24 -07:00
  • 44f7966152 tweak tag icon appearance with a slight border dave 2023-01-21 11:58:16 -08:00
  • 560f4e8132 branch-specific image names dave 2023-01-19 23:18:03 -08:00
  • 203d6f6b44 add more tag colors dave 2023-01-12 22:48:56 -08:00
  • ff8592c89d misc tweaks dave 2023-01-18 20:05:08 -08:00
  • cff6e32667 update requirements for tests api-refactor dave 2023-01-17 22:10:50 -08:00
  • 1fdf89cb2a Add user test dave 2023-01-17 22:06:26 -08:00
  • a180874e79 add basic testing dave 2023-01-17 22:04:29 -08:00
  • 971d990003 refactor startup code a bit for testing dave 2023-01-17 22:03:13 -08:00
  • 163b4e820e convert api to MethodDispatcher dave 2023-01-12 23:36:31 -08:00