Skip to content

Commit

Permalink
add text and arxiv image, reorganize.
Browse files Browse the repository at this point in the history
  • Loading branch information
yashkant authored Dec 19, 2023
1 parent 25b5914 commit 9724e94
Showing 1 changed file with 46 additions and 41 deletions.
87 changes: 46 additions & 41 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -120,8 +120,8 @@ <h2 class="col-md-12 text-center">
<div class="col-md-8 col-md-offset-2">
<ul class="nav nav-pills nav-justified">
<li>
<a href="TODO">
<image src="TODO" height="60px">
<a href="">
<image src="img/spad-ss.png" height="60px">
<h4><strong>arXiv</strong></h4>
</a>
</li>
Expand Down Expand Up @@ -165,15 +165,15 @@ <h4><strong>Code</strong></h4>
</div>
</div>

<div class="row">
<!-- <div class="row">
<div class="col-md-8 col-md-offset-2">
<video muted="" autoplay="" loop="" width="100%" height="100%">
<source src="img/vids/TODO" type="video/mp4">
</video>
</div>
</div>
</div> -->



Expand All @@ -182,7 +182,7 @@ <h4><strong>Code</strong></h4>
<h3>
tl;dr
</h3>
<image src="img/TODO" class="img-responsive" alt="overview"><br>
<image src="img/text-spad.png" class="img-responsive" alt="overview"><br>
</div>
</div>
<hr>
Expand Down Expand Up @@ -261,12 +261,6 @@ <h3>
</div>
</div>
<br>
<div class="text-center">
<div style="text-align:center;">
<image src="img/assets/sub-modules.png" class="img-responsive" alt="sub-modules"></image>
</div>
</div>
<br>
<p class="text-justify">
<b>Epipolar Attention (Left).</b>
For each <font color="red">source point S</font> on a feature map, we compute its <font color="red">epipolar lines</font> on all other views.
Expand All @@ -275,12 +269,51 @@ <h3>
<b>Illustration of one block in SPAD (Right).</b>
We add Plücker Embedding to feature maps in the self-attention layer by inflating the original QKV projection layers with zero projections.
</p>

<br>
<div class="text-center">
<div style="text-align:center;">
<image src="img/assets/sub-modules.png" class="img-responsive" alt="sub-modules"></image>
</div>
</div>

</div>
</div>
<br>
<hr>

<div class="row">
<div class="col-md-8 col-md-offset-2">
<h3>
Qualitative Result: <b>Text-to-3D Generation</b>
</h3>
Thanks to our 3D consistent multi-view generation, we can leverage the multi-view Score Distillation Sampling (SDS) for 3D asset generation.
We integrate SPAD into <a href="https://github.com/threestudio-project/threestudio">threestudio</a> and follow the training setting of <a href="https://mv-dream.github.io/">MVDream</a> to train a NeRF.
<br><br>
<p style="text-align:center;">
<image src="img/assets/text-to-3d.png" class="img-responsive" alt="3D-SDS">
</p>
<video muted="" autoplay="" loop="" width="100%">
<source src="img/vids/sds.mp4" type="video/mp4">
</video>
</div>
</div>
<br>
<hr>
<div class="row">
<div class="col-md-8 col-md-offset-2">
<h3>
Qualitative Result: <b>More Text-Guided Multi-View Generation Results</b>
</h3>
Here, we show more multi-view generation results of SPAD.
<br><br>
<p style="text-align:center;">
<image src="img/assets/more-text-to-mv.png" class="img-responsive" alt="text-to-mv">
</p>
</div>
</div>

<div class="row">
<div class="col-md-8 col-md-offset-2">
<h3>
Quantitative Result: <b>Novel View Synthesis</b>
Expand Down Expand Up @@ -318,36 +351,8 @@ <h3>
</div>
<br>
<hr>
<div class="row">
<div class="col-md-8 col-md-offset-2">
<h3>
Qualitative Result: <b>Text-to-3D Generation</b>
</h3>
Thanks to our 3D consistent multi-view generation, we can leverage the multi-view Score Distillation Sampling (SDS) for 3D asset generation.
We integrate SPAD into <a href="https://github.com/threestudio-project/threestudio">threestudio</a> and follow the training setting of <a href="https://mv-dream.github.io/">MVDream</a> to train a NeRF.
<br><br>
<p style="text-align:center;">
<image src="img/assets/text-to-3d.png" class="img-responsive" alt="3D-SDS">
</p>
<video muted="" autoplay="" loop="" width="100%">
<source src="img/vids/sds.mp4" type="video/mp4">
</video>
</div>
</div>
<br>
<hr>
<div class="row">
<div class="col-md-8 col-md-offset-2">
<h3>
Qualitative Result: <b>More Text-Guided Multi-View Generation Results</b>
</h3>
Here, we show more multi-view generation results of SPAD.
<br><br>
<p style="text-align:center;">
<image src="img/assets/more-text-to-mv.png" class="img-responsive" alt="text-to-mv">
</p>
</div>
</div>


<!-- <br>
<hr>
<div class="row">
Expand Down

0 comments on commit 9724e94

Please sign in to comment.