Overview

This project began as a final project for my ECE 593 machine learning class, but I wanted to expand its features and capabilities. My goal was to create a YOLOv4 algorithm that can classify ores within the video game of Old School RuneScape. This project was done in two stages, the first was utilizing open source software titled “Open Labeling”, then a custom classification algorithm was made using the pretrained coco dataset to be modified for my classifications for output.

Open Labeling

As an initial test, 70 images of various ores were gathered in the mining guild located within the game. Each image had 4-13 objects that were classified within the software. The 5 ores used for classification were Coal, Tin, Iron, Adamantite, and Mithril. Given the 3D nature of the game, mutiple images were taken of individual ores from all angles to be able to identify on the fly.

Open Labeling

YOLOv4 Results

Open Labeling Re Open Labeling

The Model in Action