Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Matters Arising
  • Published:

Reusability report: Feature disentanglement in generating a three-dimensional structure from a two-dimensional slice with sliceGAN

Nature Machine Intelligence volume 3, pages 861–863 (2021)Cite this article

Subjects

The Original Article was published on 05 April 2021

arising from Steve Kench & Samuel J. Cooper. Nature Machine Intelligence https://doi.org/10.1038/s42256-021-00322-1 (2021).

Deep generative models are known to be able to model arbitrary probability distributions. Among these, a recent deep generative model, dubbed sliceGAN1, proposed a new way of using the generative adversarial network (GAN) to capture the microstructural characteristics of a two-dimensional (2D) slice and generate three-dimensional (3D) volumes with similar properties. While 3D micrographs are largely beneficial in simulating diverse material behaviour, they are often much harder to obtain than their 2D counterparts. Hence, sliceGAN opens up many interesting directions of research by learning the representative distribution from 2D slices and transferring the learned knowledge to generate arbitrary 3D volumes.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Overview of AdaIN-style generator for continuous feature disentanglement of generated 3D volume.
Fig. 2: Generated samples using feature disentangled sliceGAN.

Data availability

We use the data as presented in ref. 7. The data are accessible in ref. 10.

Code availability

The code is available at https://doi.org/10.5281/zenodo.5411387https://github.com/jongcye/SliceGAN_AdaIN11.

References

  1. Kench, S. & Cooper, S. J. Generating three-dimensional structures from a two-dimensional slice with generative adversarial network-based dimensionality expansion. Nat. Mach. Intell. 3, 299–305 (2021).

  2. Karras, T., Laine, S. & Aila, T. A style-based generator architecture for generative adversarial networks. In Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition 4401–4410 (2019).

  3. Huang, X. & Belongie, S. Arbitrary style transfer in real-time with adaptive instance normalization. In Proc. IEEE International Conference on Computer Vision 1501–1510 (2017).

  4. Yang, S., Kim, E. Y. & Ye, J. C. Continuous conversion of CT kernel using switchable CycleGAN with AdaIN. IEEE Trans. Med. Imaging (in the press).

  5. Gu, J. & Ye, J. C. AdaIN-based tunable CycleGAN for efficient unsupervised low-dose CT denoising. IEEE Trans. Comput. Imaging 7, 73–85 (2021).

  6. Zhu, J.-Y., Park, T., Isola, P. & Efros, A. A. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proc. IEEE International Conference on Computer Vision 2223–2232 (2017).

  7. Hsu, T. et al. Mesoscale characterization of local property distributions in heterogeneous electrodes. J. Power Sources 386, 1–9 (2018).

    Article  Google Scholar 

  8. Groeber, M. A. & Jackson, M. A. DREAM. 3D: a digital representation environment for the analysis of microstructure in 3D. Integr. Mater. Manuf. Innov. 3, 56–72 (2014).

    Article  Google Scholar 

  9. Karras T. et al. Progressive growing of GANs for improved quality, stability, and variation. In 6th International Conference on Learning Representations (ICLR, 2018).

  10. Epting, B. SOFC Microstructures (PFIB-SEM and Synthetic) from JPS; https://doi.org/10.18141/1425617 (2018).

  11. Chung, H. HJ-harry/SliceGAN_AdaIN: v1.1 (v1.1). Zenodo https://doi.org/10.5281/ZENODO.5411387 (2021).

Download references

Acknowledgements

This research was funded by the National Research Foundation of Korea grant NRF-2020R1A2B5B03001980. This work was also supported by the Korea Medical Device Development Fund grant funded by the Korea government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety) (project number: 1711137899, KMDF_PR_20200901_0015).

Author information

Authors and Affiliations

  1. Department of Bio and Brain Engineering, KAIST, Daejeon, Korea

    Hyungjin Chung & Jong Chul Ye

Authors
  1. Hyungjin Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jong Chul Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

H.C. performed all experiments, wrote the extended code and prepared the manuscript. J.C.Y. supervised the project in conception and discussion and prepared the manuscript.

Corresponding author

Correspondence to Jong Chul Ye.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Peer review information Nature Machine Intelligence thanks the anonymous reviewers for their contribution to the peer review of this work.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chung, H., Ye, J.C. Reusability report: Feature disentanglement in generating a three-dimensional structure from a two-dimensional slice with sliceGAN. Nat Mach Intell 3, 861–863 (2021). https://doi.org/10.1038/s42256-021-00400-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s42256-021-00400-4

This article is cited by

Search

Advanced search

Quick links

Nature Briefing AI and Robotics

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: AI and Robotics