Benefits of Contrast Hydrotherapy

Contrast showers, sometimes also known as contrast hydrotherapy, are showers in which our body temperature changes from hot to cold and back again by alternating between hot then cold water. A contrast shower usually consists of three to five complete cycles of hot and cold water. The hot water causes blood vessels to dilate, thereby pushing the blood to the skin’s surface, and cold water … Continue reading Benefits of Contrast Hydrotherapy

How I got top-5 in an Elite Beast Spartan Race

The ultimate Spartan test; a soul crushing half marathon with 30 obstacles. You’ll rarely find a Beast on flat ground, so your legs will burn with brutal ascents and descents. The Beast is notorious around the world for its difficulty. Beast Spartan Race In this post, I’m going to write about how I prepared my first Elite BEAST Spartan Race and will share my impressions … Continue reading How I got top-5 in an Elite Beast Spartan Race

Visualizing Loss Landscape of GAIL

This post aims to visualize the loss landscape of some imitation policies (IL policies) trained with GAIL, and their discriminator trained in three common environments: Cartpole, Lunarlander, and Walker2d from Mujoco. The expert policy of Cartpole and Lunarlander is a simple Double DQN while the expert of Walker2d, which supports continuous actions, is a DDPG policy. The imitation policies are the same policies employed by their … Continue reading Visualizing Loss Landscape of GAIL

Learning to imitate: using GAIL to imitate PPO

Usually, in reinforcement learning, the agent is provided with a reward according to the action it executes to interact with the environment and its goal is to optimize its total cumulative reward over multiple steps. Actions are selected according to some observations the agent has to learn to interpret. In this post, we are going to explore a new field called imitation learning: the agent … Continue reading Learning to imitate: using GAIL to imitate PPO

How I got top-10 in an Elite Super Spartan Race

There’s nothing mediocre about this middle distance race. The Spartan Super offers the ideal blend between distance and speed. Offering racers a true athletic test. If you consider yourself a more seasoned athlete determined to push beyond excuses, you just might have the mettle for a Spartan Super. Serving up 25+ Spartan Obstacles and 10+km of rugged terrain, the Spartan Super spares no one. Developed … Continue reading How I got top-10 in an Elite Super Spartan Race

The training schedule of a Spartan

This is a sort of diary that records all of my training from January 2021 to July 2021 included. Due to an incident that happened during an ultra-trail race in the province of Gansu at the end of May that provoked the death of many runners, most of the races that had to take place between June and July were canceled or postponed. This resulted … Continue reading The training schedule of a Spartan

Concatenation of all combinations of words

Given a string s and some strings words of the same length. Find all the starting positions of the substrings in s that can be formed by concatenating all the strings in words. Note that the substrings must exactly match the strings in words, and there can be no other characters in the middle, but there is no need to consider the order of the … Continue reading Concatenation of all combinations of words

Automatic code generator for training Reinforcement Learning policies

Generate custom template code to train you reinforcement learning policy using a simple web UI built with streamlit. It includes different environments and can be expanded to support multiple policies and frameworks with an high level of flexible hyperparameters customization. The generated code can be easily downloaded as .py file or Jupyter Notebook so to immediately start training your model or use it as a baseline … Continue reading Automatic code generator for training Reinforcement Learning policies

How Genify used a Transformer-based model to build a recommender system that outperforms industry benchmarks

The rapid ascension of AI, and more recently of deep learning, comported a succession of many breakthroughs in the field of computer science. These have had a profound impact on both the academic and the business world. In particular, modern deep learning techniques applied to the pre-existing concept of recommender systems has given birth to a new, superior class of neural recommender systems, which are … Continue reading How Genify used a Transformer-based model to build a recommender system that outperforms industry benchmarks