Possible Ink Patterns on Scroll4
The model kind of self-learned these ink patterns. The approach was the following:
- 1. First, I trained a base model across all fragments and one segment of a scroll. This model could identify some characters across all fragments when applied.
- 2. After that, I applied the pre-trained model to Scroll 4. Some fragments of characters emerged, and I examined these positions in the layers and realized that these character fragments correlated with some visual patterns on the layers (especially in the vicinity of layer 30).
- 3. After that, I tried fine-tuning the model with manual annotations of more of these ink patterns, which led to the result I shared.
Ink Pattern: Rocky Landscapes
Ink Pattern: Soft Crackle
Ink Pattern: Moon Craters
Ink Pattern: Unclear
The model also occasionally detected these things as ink. Its unclear if these featureless flat areas or metally looking features can be ink or not.
Ink Patterns in Action
There are some of the best examples where these ink patterns are in action. It's always the layer where the pattern is most prominent, but it mostly occurs across multiple layers.These animations also show that the model does not always catch the pattern perfectly, so there seems to be a lot of room for further fine-tuning. There are also videos allowing you to scroll through all layers for these characters...