IJCAI 2023poster12 citations

STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar?

Xin Zhao, Jifeng Guo, Lin Wang, Fanqi Li, Jiahao Li, Junteng Zheng, Bo Yang

Abstract

Solid texture synthesis (STS), an effective way to extend a 2D exemplar to a 3D solid volume, exhibits advantages in computational photography. However, existing methods generally fail to accurately learn arbitrary textures, which may result in the failure to synthesize solid textures with high fidelity. In this paper, we propose a novel generative adversarial nets-based framework (STS-GAN) to extend the given 2D exemplar to arbitrary 3D solid textures. In STS-GAN, multi-scale 2D texture discriminators evaluate the similarity between the given 2D exemplar and slices from the generated 3D texture, promoting the 3D texture generator synthesizing realistic solid textures. Finally, experiments demonstrate that the proposed method can generate high-fidelity solid textures with similar visual characteristics to the 2D exemplar.

Computer Vision: CV: Computational photographyComputer Vision: CV: 3D computer visionComputer Vision: CV: Neural generative models, auto encoders, GANs
BibTeX
@inproceedings{ijcai2023p196,
  title     = {STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar?},
  author    = {Zhao, Xin and Guo, Jifeng and Wang, Lin and Li, Fanqi and Li, Jiahao and Zheng, Junteng and Yang, Bo},
  booktitle = {Proceedings of the Thirty-Second International Joint Conference on
               Artificial Intelligence, {IJCAI-23}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},
  editor    = {Edith Elkind},
  pages     = {1768--1776},
  year      = {2023},
  month     = {8},
  note      = {Main Track},
  doi       = {10.24963/ijcai.2023/196},
  url       = {https://doi.org/10.24963/ijcai.2023/196},
}
STS-GAN: Can We Synthesize Solid Texture with High Fidelity from Arbitrary 2D Exemplar? · IJCAI 2023