← all posts site ↗

substance painter alternative with AI

saw someone build a browser-based texture painting tool as a free alternative to Substance Painter and it clicked immediately. i've been thinking about how to approach this and the real value isn't the painting interface — that's table stakes. the killer feature is text to PBR material set and AI-assisted texture repair. paint rough color, AI converts it to realistic albedo, normal, roughness, metallic, AO, and height maps. select a damaged or blank region and AI fills it seamlessly.

the stack would be WebGL or WebGPU for the 3D viewport using Three.js, Canvas 2D for the texture painting layer, and Pyodide or WASM for heavy lifting with a lightweight backend for AI calls. you drag and drop a glb or fbx model, render it with PBR materials, and paint directly on UV-unwrapped meshes with each brush stroke mapping UV coordinates to texture space. the hard part is the UV to screen-space coordinate mapping and layer compositing, especially normal map blending which isn't trivial.

free texture sources to pull from include Poly Haven with CC0 high quality PBR sets, ambientCG, and 3D Textures for procedural maps. the MVP path is viewer with UV display in two weeks, single-layer brush painting in one week, AI texture generation from text prompts in one week, multi-layer compositing in two weeks, and AI-assisted inpainting in one week. total about seven weeks for a functional tool that actually differentiates itself from the monthly Adobe subscription model.