Commit Graph

54 Commits

Author SHA1 Message Date
Carl-Gerhard Lindesvärd
a11f87dc3c improve: logging for session handling 2025-10-08 10:44:02 +02:00
Carl-Gerhard Lindesvärd
0b4fcbad69 feat: use groupmq instead of bullmq for incoming events (#206)
* wip

* wip working group queue

* wip

* wip

* wip

* fix: groupmq package (tests failed)

* minor fixes

* fix: zero is fine for duration

* add logger

* fix: make buffers more lightweight

* bump groupmq

* new buffers and bump groupmq

* fix: buffers based on comments

* fix: use profileId as groupId if exists

* bump groupmq

* add concurrency env for only events
2025-10-04 21:07:55 +02:00
Carl-Gerhard Lindesvärd
5445d6309e test: add vitest
* feature(root): add vitest and some basic tests

* fix(test): after rebase + added referrars test and more sites

* fix(test): test broken after rebase

* fix(test): provide db url to make prisma happy

* fix tests
2025-06-06 19:14:18 +02:00
Carl-Gerhard Lindesvärd
0d58a5bf0c improve(queue): how we handle incoming events and session ends 2025-06-03 21:19:01 +02:00
Carl-Gerhard Lindesvärd
59012526e2 fix(worker): add reqId to logger for better traceability 2025-02-19 10:33:42 +01:00
Carl-Gerhard Lindesvärd
8e94ce5877 fix(buffer): merge events in queue and get last screen view from buffer instead of cache 2025-02-18 23:08:38 +01:00
Carl-Gerhard Lindesvärd
344bfd1687 fix(buffer): debug stalled events 2025-02-18 10:32:27 +01:00
Carl-Gerhard Lindesvärd
ff2dca42f6 improve(buffer): prep postgres buffer 2025-02-03 09:19:00 +01:00
Carl-Gerhard Lindesvärd
71bf22af51 feature(queue): use postgres instead of redis for buffer
* wip(buffer): initial implementation of psql buffer

* wip(buffer): add both profile and bots buffer
2025-01-30 22:50:57 +00:00
Carl-Gerhard Lindesvärd
60525f8905 feature(api): override user-agent information 2024-11-19 11:13:24 +01:00
Carl-Gerhard Lindesvärd
a022cb4831 feature(public,docs): new public website and docs 2024-11-13 21:15:46 +01:00
Carl-Gerhard Lindesvärd
4fe338c628 feature(api,worker): Override default timestamp with a date from the past (#76)
* feature(worker,api): refactor incoming events and support custom timestamps from the past

* fix(queue): add retry logic to events queue

* fix(worker): remove properties when merging server events
2024-10-22 10:25:21 +02:00
Carl-Gerhard Lindesvärd
301d86aa71 fix(common): move ua parser to common and import isServer flag 2024-10-05 23:44:56 +02:00
Carl-Gerhard Lindesvärd
153faab878 fix(worker): minor improvements for incoming events 2024-10-05 22:36:02 +02:00
Carl-Gerhard Lindesvärd
f65a633403 feature(dashboard): add integrations and notifications 2024-10-02 22:41:35 +02:00
Carl-Gerhard Lindesvärd
0167d9a761 fix(worker): try wait 10 times before failing 2024-09-25 10:01:26 +02:00
Carl-Gerhard Lindesvärd
ea141e99a2 fix(worker): handle edge cases when jobs are not delayed 2024-09-25 09:11:54 +02:00
Carl-Gerhard Lindesvärd
66a49c53cf fix(worker): avoid creating new loggers 2024-09-24 22:13:15 +02:00
Carl-Gerhard Lindesvärd
25a7365569 perf(worker): try to improve perf of worker 2024-09-24 09:19:30 +02:00
Carl-Gerhard Lindesvärd
a1278ca371 fix(worker): try speed up 2024-09-23 20:06:30 +02:00
Carl-Gerhard Lindesvärd
dce974512f perf(worker): minor improvements to worker 2024-09-22 22:31:28 +02:00
Carl-Gerhard Lindesvärd
dfe00040de chore(buffer): final adjustments to buffer before deploy 2024-09-18 23:46:38 +02:00
Carl-Gerhard Lindesvärd
545cbfd520 feature(worker+api): improve buffer 2024-09-18 23:46:37 +02:00
Carl-Gerhard Lindesvärd
32e91959f6 chore(root): migrate to biome 2024-09-18 23:46:11 +02:00
Carl-Gerhard Lindesvärd
447f303aa4 fix(worker): avoid workers getting blocked 2024-09-13 17:51:29 +02:00
Carl-Gerhard Lindesvärd
32025c61ce chore(worker): minor adjustment to worker 2024-09-10 23:31:11 +02:00
Carl-Gerhard Lindesvärd
63168eafde handle session_end when no session_start was found 2024-09-02 20:36:59 +02:00
Carl-Gerhard Lindesvärd
c82247143c fix 2024-08-11 22:48:22 +02:00
Carl-Gerhard Lindesvärd
fd92e703e4 parse server user-agents better 2024-08-11 22:45:52 +02:00
Carl-Gerhard Lindesvärd
6934959d5b minor worker fix 2024-08-11 22:34:11 +02:00
Carl-Gerhard Lindesvärd
bda0204205 fix get profile id function 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
887b187b3d fix 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
b02cbb2946 add better cache for getProfileId 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
7d703bcd80 fix profile id 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
ccfddc215f save sdk name and version 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
41e46570b7 improvements while testing 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
15e997129a initial for v1 2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
0fea45c9f7 rename IServiceCreateEventPayload 2024-07-21 23:55:04 +02:00
Carl-Gerhard Lindesvärd
1b613538cc first working cli importer 2024-07-21 23:55:04 +02:00
Carl-Gerhard Lindesvärd
f2298a1b05 init redis lazy 2024-07-20 20:17:32 +02:00
Carl-Gerhard Lindesvärd
492141547d improve session end 2024-07-20 16:34:31 +02:00
Carl-Gerhard Lindesvärd
ec39b1fccc change imports 2024-07-17 22:00:50 +02:00
Carl-Gerhard Lindesvärd
5e225b7ae6 batching events 2024-07-17 17:27:19 +02:00
Carl-Gerhard Lindesvärd
244aa3b0d3 fix delayed jobs 2024-07-15 20:25:01 +02:00
Carl-Gerhard Lindesvärd
41143ca5f8 ADD CROSS DOMAIN SUPPORT 2024-06-26 22:35:29 +02:00
Carl-Gerhard Lindesvärd
cf8617e809 multiple breakpoints 2024-06-20 23:25:18 +02:00
Carl-Gerhard Lindesvärd
7d35f7e65c add origin to events 2024-06-16 21:24:34 +02:00
Carl-Gerhard Lindesvärd
494044a3e2 speed up worker 2024-05-13 22:43:07 +02:00
Carl-Gerhard Lindesvärd
0975a20e17 add long and lat to events 2024-05-09 21:49:56 +02:00
Carl-Gerhard Lindesvärd
3aecbfe627 get oldest delayed job 2024-05-05 15:20:55 +02:00