Skip to content

Should we store markdown, HTML, or both?

TalkMoro stores body and body_html. Re-rendering on every read is a non-starter. Re-rendering on every edit is cheap.

The expensive case is a renderer change (heading ids, task lists) across ten million posts. We are testing a background job that rewrites HTML in 5_000-row batches so 1 MB of posts is 1_000_000 bytes of markdown, not a table rewrite.

Anyone else version the HTML renderer?

5 replies

Posted a Guide recap of this thread so we are not asking people to mine comments.

Permalink

For campus we used entity_type=course and left the template as Question. Search Console looks sane.

Permalink

Staff view: please do not delete the thread if this is a duplicate. Link the canonical Issue instead.

Permalink

We hit the same wall on should. Replica lag was the surprise, not CPU.

Permalink

Thanks — leaving this up for the next team that searches the same string.

Permalink

Weekly winners

Should we store markdown, HTML, or both?

TalkMoro stores body and body_html. Re-rendering on every read is a non-starter. Re-rendering on every edit is cheap.

The expensive case is a renderer change (heading ids, task lists) across ten million posts. We are testing a background job that rewrites HTML in 5_000-row batches so 1 MB of posts is 1_000_000 bytes of markdown, not a table rewrite.

Anyone else version the HTML renderer?

Replies 5

Elena Rostova
ModMember

@elena_support

Posted a Guide recap of this thread so we are not asking people to mine comments.

Elena Rostova
ModMember

@elena_support

For campus we used entity_type=course and left the template as Question. Search Console looks sane.

Marcus Vance

@marcus_dev

Staff view: please do not delete the thread if this is a duplicate. Link the canonical Issue instead.

Jordan Hale

@jordan_design

We hit the same wall on should. Replica lag was the surprise, not CPU.

Elena Rostova
ModMember

@elena_support

Thanks — leaving this up for the next team that searches the same string.

Join the conversation

Sign in or create an account to share your thoughts, solutions, or feedback.