Carl-Gerhard Lindesvärd
289ffb7d6d
wip
2026-03-18 21:16:16 +01:00
Carl-Gerhard Lindesvärd
90881e5ffb
wip
2026-03-18 21:16:16 +01:00
Carl-Gerhard Lindesvärd
4483e464d1
fix: optimize event buffer ( #278 )
...
* fix: how we fetch profiles in the buffer
* perf: optimize event buffer
* remove unused file
* fix
* wip
* wip: try groupmq 2
* try simplified event buffer with duration calculation on the fly instead
2026-03-16 13:29:40 +01:00
Carl-Gerhard Lindesvärd
ed8b5c667e
fix: how we fetch profiles in the buffer
2026-02-06 13:14:12 +00:00
Carl-Gerhard Lindesvärd
329f76b7ce
fix: avoid overwrite profile properties (geo etc) when profile is from server
2025-12-15 22:11:07 +01:00
Carl-Gerhard Lindesvärd
da59622dce
fix: overall perf improvements
...
* fix: ignore private ips
* fix: performance related fixes
* fix: simply event buffer
* fix: default to 1 events queue shard
* add: cleanup scripts
* fix: comments
* fix comments
* fix
* fix: groupmq
* wip
* fix: sync cachable
* remove cluster names and add it behind env flag (if someone want to scale)
* fix
* wip
* better logger
* remove reqid and user agent
* fix lock
* remove wait_for_async_insert
2025-11-15 22:13:59 +01:00
Carl-Gerhard Lindesvärd
0b4fcbad69
feat: use groupmq instead of bullmq for incoming events ( #206 )
...
* wip
* wip working group queue
* wip
* wip
* wip
* fix: groupmq package (tests failed)
* minor fixes
* fix: zero is fine for duration
* add logger
* fix: make buffers more lightweight
* bump groupmq
* new buffers and bump groupmq
* fix: buffers based on comments
* fix: use profileId as groupId if exists
* bump groupmq
* add concurrency env for only events
2025-10-04 21:07:55 +02:00
Carl-Gerhard Lindesvärd
ec8aaf24fb
fix(buffer): move to redis again 😅 but better
2025-02-08 21:38:27 +01:00
Carl-Gerhard Lindesvärd
a2b74a9b4d
test(buffer): testing new buffer (only inserts, no processing)
2025-01-31 00:09:25 +00:00
Carl-Gerhard Lindesvärd
500cce2918
fix(buffer): ensure insert correct date format
2024-11-30 22:48:07 +01:00
Carl-Gerhard Lindesvärd
d80754a6fd
fix(buffer): max call stack issue with buffer
2024-11-29 10:39:12 +01:00
Carl-Gerhard Lindesvärd
e21cd7ed73
revert
2024-11-28 21:11:22 +01:00
Carl-Gerhard Lindesvärd
ab8bce7752
chore(dashboard,db): prepping for migration time
2024-11-28 20:58:18 +01:00
Carl-Gerhard Lindesvärd
25a7365569
perf(worker): try to improve perf of worker
2024-09-24 09:19:30 +02:00
Carl-Gerhard Lindesvärd
545cbfd520
feature(worker+api): improve buffer
2024-09-18 23:46:37 +02:00
Carl-Gerhard Lindesvärd
32e91959f6
chore(root): migrate to biome
2024-09-18 23:46:11 +02:00
Carl-Gerhard Lindesvärd
c674127784
test(buffer): disable auto flush on profile
2024-09-14 22:57:50 +02:00
Carl-Gerhard Lindesvärd
efd24ca67a
perf(api): improve inserting events
2024-09-12 22:09:35 +02:00
Carl-Gerhard Lindesvärd
46fe17e558
perf(api): add bot events with buffer
2024-09-12 20:51:54 +02:00
Carl-Gerhard Lindesvärd
ccfddc215f
save sdk name and version
2024-08-09 23:00:38 +02:00
Carl-Gerhard Lindesvärd
89c5732efe
fix redis timeout connection on serverless (avoid init redis directly)
2024-07-22 21:49:46 +02:00
Carl-Gerhard Lindesvärd
f2298a1b05
init redis lazy
2024-07-20 20:17:32 +02:00
Carl-Gerhard Lindesvärd
5e225b7ae6
batching events
2024-07-17 17:27:19 +02:00
