Minor domain fix

v2.5.10

Update setup.py

Added raw/translated content

We added the raw & translated content to the IPFS uploads.
This provide more content to the Network.

Improved translation modules + Dockerfile minor fix Latest

Improved translation modules + Dockerfile minor fix
Latest Argostranslate updated to version 1.9.6, with CTranslate2 indirectly bumped to v4.

Real Offline Version (Dockerfile) + More resilience

New Features and Improvements

• Enhanced Offline Support: We've made significant strides in enhancing the offline capabilities of our workers. By setting TRANSFORMERS_OFFLINE=1, HF_DATASETS_OFFLINE=1, and HF_HUB_OFFLINE=1, we ensure that our dependencies on external services like Hugging Face are minimized. This update includes caching for fasttext-langdetect/lid.176.bin, Hugging Face-based models, and Argos Translate models, ensuring that our workers can operate completely offline without any hiccups.

• Increased Resilience: Our workers are now more resilient than ever. They no longer depend heavily on third-party services, which means temporary outages or HTTP errors from platforms like GitHub will not disrupt our operations as before. This marks a significant step towards our goal of decentralization, reducing our dependency on external services and enhancing our system's robustness.

• WtpSplit Version 1.3.0: The WtpSplit tool has been upgraded to version 1.3.0. This update brings improvements in language detection accuracy, making it easier and more reliable to determine the language from text. This enhancement is part of our continuous effort to improve the functionality and performance of our tools.

Thank you for your continued support and feedback, which help us make [Your Project Name] better with each release.

Minor keyword fix + Network Tx gas cap decrease

• Less gas per tx, more tx per block, less time to wait for spotData tx inclusions on Exorde skale chain
• Minor fix on extract_keywords.py, which was leading to divisions by zero

Resilience fix - HuggingFace Models Offline mode + keyword capped at 50 chars max (instead of nocap)

• HuggingFace Models Offline mode
  -> the client will initialize itself and download all models, then set itself to offline mode, to never have any interaction with huggingface
  -> goal = no deps on HuggingFace servers

• minor fix on keywords
  they are now capped at 50 chars max, instead of no limit before

Minor fixes - Multilang keyword selection - Web interface (debug) - Sentiment v2

Multilang keyword selection
Web interface (debug)
Stability fixes
Performance improvement
Sentiment upgraded

2.5.1 - custom batch size, PUSH notification system, regular updates about REP & collected items over last 24h

v2.5.1

Update setup.py

2.5.0 - custom batch size, PUSH notification system, regular updates about REP & collected items over last 24h

Release 2.5.0 - Key Features

1. Custom Batch Size

Introduces a new --custom_batch_size N option. Use it & you can override the batch size (between 10 & 200).
Recommended values are between 10 & 50.

2. Notifications Enhancement

Adds a new --ntfy argument for enhanced notifications.
Sends a notification when the application starts.
Implements a notification function.
Prepares the status_notification for future improvements.

3. Data Collection and Persistence

Displays a message: "Your collected {rep} unique posts over the last 24h."
Statistics are now persistently stored.
Improves persist.py, including testing concurrent writes and abrupt cancellations.
Introduces a custom serializer.
Introduces the PersistedDict class.
Enhances the once_per_day function using persistence.
Implements notify_at for scheduled notifications.
Sets source_type from process_batch with a static social list.
Updates the IPFS schema following previous changes.
Renames status_notification to statistics_notification.
Introduces docker_version_notifier.
Adds informative messages about ntfy when it is used.
Fixes an embarrassing typo: "embarassement" -> "embarrassment".

Improved keyword extraction: 2-grams, better handling of $XXX # and other special chars, smarter keywords for a better topic monitoring.

This release introduces custom batch sizes, enhances notifications, and improves data collection and persistence, making it a significant update for the Exorde client.

Minor fix on brain + robustness upgrade

v2.4.9

Update setup.py