Learning to imitate: using GAIL to imitate PPO

Usually, in reinforcement learning, the agent is provided with a reward according to the action it executes to interact with the environment and its goal is to optimize its total cumulative reward over multiple steps. Actions are selected according to some observations the agent has to learn to interpret. In this post, we are going to explore a new field called imitation learning: the agent … Continue reading Learning to imitate: using GAIL to imitate PPO

How I got top-10 in an Elite Super Spartan Race

There’s nothing mediocre about this middle distance race. The Spartan Super offers the ideal blend between distance and speed. Offering racers a true athletic test. If you consider yourself a more seasoned athlete determined to push beyond excuses, you just might have the mettle for a Spartan Super. Serving up 25+ Spartan Obstacles and 10+km of rugged terrain, the Spartan Super spares no one. Developed … Continue reading How I got top-10 in an Elite Super Spartan Race

The training schedule of a Spartan

This is a sort of diary that records all of my training since January 2021 to May 2021 included. 1 Jan: REST🧘2 Jan: workout (1h)💪3 Jan: 10km (4’10” pace)🏃‍♂️4 Jan: gym (1h)🏋️5 Jan: 10km (4’05” pace)🏃‍♂️6 Jan: workout (1h)💪7 Jan: 9km indoor (4’40” pace)🏃‍♂️8 Jan: gym (1h)🏋️9 Jan: 10km (4’10” pace)🏃‍♂️10 Jan: swimming (1.3 km)🏊‍♂️11 Jan: gym (1h)🏋️12 Jan: 8×800 (2’40” with 2′ rest)🏃‍♂️13 Jan: … Continue reading The training schedule of a Spartan

Concatenation of all combinations of words

Given a string s and some strings words of the same length. Find all the starting positions of the substrings in s that can be formed by concatenating all the strings in words. Note that the substrings must exactly match the strings in words, and there can be no other characters in the middle, but there is no need to consider the order of the … Continue reading Concatenation of all combinations of words

Automatic code generator for training Reinforcement Learning policies

Generate custom template code to train you reinforcement learning policy using a simple web UI built with streamlit. It includes different environments and can be expanded to support multiple policies and frameworks with an high level of flexible hyperparameters customization. The generated code can be easily downloaded as .py file or Jupyter Notebook so to immediately start training your model or use it as a baseline … Continue reading Automatic code generator for training Reinforcement Learning policies

How Genify used a Transformer-based model to build a recommender system that outperforms industry benchmarks

The rapid ascension of AI, and more recently of deep learning, comported a succession of many breakthroughs in the field of computer science. These have had a profound impact on both the academic and the business world. In particular, modern deep learning techniques applied to the pre-existing concept of recommender systems has given birth to a new, superior class of neural recommender systems, which are … Continue reading How Genify used a Transformer-based model to build a recommender system that outperforms industry benchmarks

Genify’s experience testing Amazon Personalize: learnings and limitations

Challenges of machine learning Machine learning is a complex field that borrows elements from different areas such as computer science, algebra and statistics. Hence, it is not immediate, even for experts in the field, to build strong machine learning models to solve predefined task. Furthermore, those models should also be optimized with a time-consuming and repetitive hyper-parameters search in order to find the best set … Continue reading Genify’s experience testing Amazon Personalize: learnings and limitations

SeqGAN: text generation with generative models

In this post we propose to review recent history of research in the Natural Language Generation (NLG) tasks of the Natural Language Processing domain. Realistic human-like language generation has been a challenge for researches that has recently come into greater focus with the release of large neural models for NLP like the GPT and BERT models. In this post we propose to focus ourselves on … Continue reading SeqGAN: text generation with generative models

How I prepared an Elite Super Spartan Race

There’s nothing mediocre about this middle distance race. The Spartan Super offers the ideal blend between distance and speed. Offering racers a true athletic test. If you consider yourself a more seasoned athlete determined to push beyond excuses, you just might have the mettle for a Spartan Super. Serving up 25+ Spartan Obstacles and 10+km of rugged terrain, the Spartan Super spares no one. Developed … Continue reading How I prepared an Elite Super Spartan Race