Recent posts

Four Seasons at SNU: An Interactive Panorama

0

Seoul National University campus changes its appearance throughout the year. The interactive panorama shows the landscape in four seasons. You can use a mouse or a touch to control a viewing direction and a time.

[WebGL] WebGL vs. WebGPU

0

In May 2024, Three.js Shading Language (TSL) was introduced to support WebGPU. WebGPU supports general-purpose GPU computing, making it flexible in general-purpose GPU usage. In this post, I’ll briefly describe how to deal with WebGPU compared to WebGL.

Simulate Visual Sensors in MuJoCo

0

MuJoCo provides two fundamentally different mechanisms for visual sensing. Camera-based sensors (RGB, depth, segmentation) are implemented through offscreen OpenGL rendering via the mujoco.Renderer class. Rangefinder-based sensors (LiDAR) are native MuJoCo sensors that use CPU raycasting and w...

Policy Gradient Methods: REINFORCE, Actor-Critic, A3C, and A2C

0

The previous post derived DQN, DDQN, and Dueling DQN. These value-based methods learn Q-function and follow a policy that maximizes Q-function. This approach works well for discrete action spaces but cannot be applied when actions are continuous, since the maximization step is no longer proces...

Balancing a Double Pendulum with DQN and MuJoCo

0

A double pendulum consists of two pendulums attached to each other, and is a classic physical system that exhibits complex and chaotic motion. The balancing problem of double pendulum using only a single motor on the first joint is a well-known benchmark in control theory and robotics. This po...