Submitted by raddleboy in Tech

I have a large text doc to which i keep on adding, i would also like to be able to add images and stuff to it but... that would make the document too big.

Is there a way that i can add images and other items all the while keeping that document manageable and searchable?

What other options do i have?

9

Comments

You must log in or register to comment.

aaaaargZombies wrote

I'd echo what everyone else has said, you want to avoid a single doc for the reasons you've given. you've probably already used markdown posting here so that's a great place to start.

Self contained tools that will let you create, edit, view and search linked documents.

Command line tools for searching collections of text (markdown) files.

6

inthedustofthisplanet wrote (edited )

Sure, do it in Markdown and host the file remotely. You can do it just like putting links here on raddle like: [url name](url). This may not help your specific issue, but you can also consider compressing the images to something with a smaller file size like JPG or GIF.

I use Typora. You can use Typora to export docs as PDF or EPUB and the images referenced will be "baked" into the PDF/EPUB.

5

raddleboy OP wrote (edited )

You seem like a friend on here /u/inthedustoftheplanet

Instead of clarifying myself further, i'll give you the problem.

The problem -

YOU have a personal diary/journal. You want to add pictures, videos and whatnot to it. But adding them would make your diary/journal unusable (bcz it would be insanely huge 100-200 gb atleast, by the time you die). You tried adding hyperlinks but they were useless when you inevitably changed your setup or moved or renamed the file. But you still want to add objects. how do you do it?

Rules -

Keep it offline

keep it as safe as possible

5

moonlune wrote

Her methode is still the best way to do it and have workarounds to your problems.

(bcz it would be insanely huge 100-200 gb atleast, by the time you die)

the whole of wikipedia is 70 gb (20gb compressed). You've got time.

5

inthedustofthisplanet wrote (edited )

Your best option is to compress the images given the constraints you have. If the unusability is due to the file size then I would consider breaking the journal/diary into smaller parts and compress and encrypt all entries older than a certain date.

I would consider getting an external hard-drive to store the data on, which can then be encrypted. Honestly, compression isn't even the biggest help here, but I think if I understand correctly you have one massive file that possibly takes a long time to load in which case follow my advice above and begin cutting it into smaller sections.

The setup I would do is something like this:

diary/
├── 12-10-2021
│   ├── entries
│   └── img
├── 13-10-2021
│   ├── entries
│   └── img
├── 14-10-2021
│   ├── entries
│   └── img
├── 15-10-2021
│   ├── entries
│   └── img
├── 16-10-2021
│   ├── entries
│   └── img
├── 17-10-2021
│   ├── entries
│   └── img
└── 18-10-2021
    ├── entries
    └── img

I would use Typora to make a Markdown file for each day and make the references to the images in the /img sub-directory for each day and store the markdown and pdf files in their respective places like so, using mkdir $(date +"%d-%m-%Y/entries/img") -p, which creates a directory with the current date and the entries and img sub directories:

12-10-2021/
└── entries
    ├── img
    │   ├── anotherexample.mp4
    │   └── example.jpg
    ├── journalentry.md
    └── journalentry.pdf

I am sure there is ways of improving this and to be honest tools that probably automate a lot of it. I've considered writing my own journal program in python before... just more reason to do so!


You seem like a friend on here /u/inthedustoftheplanet

<3

4

NOISEBOB wrote

sounds like you need a wiki...

if you can host yourself, i'd suggest https://www.dokuwiki.org/

or if you want it as a standalone program on your computer, go for https://zim-wiki.org/ or https://tiddlywiki.com/ that you can just keep on a memory stick (but it is kind of strange imo)....

4

raddleboy OP wrote

Simply put, i have a journal. It would be nice if i could figure out a way to add as many objects (images, videos) i want, all the while having a single searchable document.

i wish i could link the files instead but those links become worthless when i chnage PC's.

Can i do this using tiddly or zim? Will i be able to easily shift to another app? What else would you suggest?

4

inthedustofthisplanet wrote (edited )

If you really do need it to be a single searchable document (I replied to your other post before seeing this lol) then a wiki would be a good option. You can always host this on your local network so only you have access to it.

4

nulloperation wrote

Try Org mode.

4

raddleboy OP wrote

i read it. But could you explain how exactly does it help me. I'll have to read it again.

5

annikastheory wrote

It's terrible use vim /s

But in all seriousness its just a markdown wiki for a specific text editor known as emacs. Emacs (like vim) is text editor used in a computer terminal (rather than with a Gui). So everything is keyboard driven. I've heard its great as far as those things go. But unless you are interested in learning emacs I wouldn't recommend it. I keep my wiki in Vim and also wouldn't recommend that unless you wanted to learn vim.

Console text editors tend to be great at speed, even with large files. And they tend to be really great at searching. Other than that it would offer the same benefits markdown offers which have already been outlined by /u/inthedustofthisplanet

5

moonlune wrote (edited )

org mode is a little more than a emacs specific markup language.

The key difference with other markup languages ones is that it's meant to be interactive, it's almost its own program ( I think the whole document is inside the REPL, so whatever you write gets executed). For example you can do spreadsheets and talbes, and have dates (like, if you write "next week", it'll automatically convert it to date+7) and an easy handling of tasks (write TODO and when you've done your task, it'll write DONE with the date and completion time, + task hierarchies).

It's very good for writing in documents with which you want to interact often, like for short note taking and as an agenda and todo list. I used it in a lab while doing experiments over several months and talking to my colleagues and it was quite handy for organizing my tasks and notes and pretty much everything.

4

annikastheory wrote

Yeah I probably oversimplified a little, but I did say a "markdown wiki", and by that I meant that it also had wiki-like features. My main thing was to say that unless you are inclined to learning a new way of doing things I would avoid doing anything in a terminal text editor.

But org-mode does look awesome everyone sings its praises for sure. I've seen many people say its the reason they choose emacs over vim.

5

nulloperation wrote (edited )

It's terrible use vim /s

this but without the "/s", and then using pandoc (and hence, LaTeX) for pdf (or msword or whatevs) export of your markdown text file, because OP was talking about there being lots of images. or, you use weasyprint if you don't like pandoc. or apple's webkit even. then, when you find a good one, assign a good keybinding for it in vim, to make the pdf and open it in a pdf viewer (mupdf is very lightweight).

3

annikastheory wrote (edited )

That's more or less what I do. Except I use a filetype plugin to set the makeprg to pandoc and then I just do :make. Though in reality I basically never do that because I don't usually need pictures as much as I think I do.

Edit: also are you arguing against yourself about vim being better than emacs?

4

nulloperation wrote

Edit: also are you arguing against yourself about vim being better than emacs?

Well, OP was asking about good text editors, and I wanted to be impartial. But it's also more complicated than vi(m) vs emacs, e.g. when considering evil (a decent implementation of vi(m) in emacs).

I think it comes down to whether you prefer using one monolithic program where you have all your files open (which is arguably the emacs way), or several instances of do one thing and do it well-style programs (which I think vim is more suited for).

Take email: In emacs, you'd open the email client inside emacs; whereas with vim, you'd have mutt spawn a vim for composing or replying to messages.

I really want to like emacs as I'd take any lisp any day over vimscript, python or lua. Emacs clearly has better at syntax highlighting, especially stuff like JS inside HTML, and Org Mode is killer feature, both for code folding, but also for running code snippets in any language. Emacs is objectively better written software, but those utterly indescribably horrifyingly messed up keybindings are so deeply embedded in emacs that it's beyond repair.

When I lost my emacs config file, I switched back to vim again, yet I'm still looking for decent alternatives to Org Mode and to ediprolog.

4

nulloperation wrote

Is there a way that i can add images and other items all the while keeping that document manageable and searchable?

Yes. Org Mode uses hyperlinks though, so you'd have to not shuffle them around, or if you do, provide a symlink to wherever you put the image folder. Org Mode makes text navigation easier by folding: You can fold sections by headlines and subheadlines, so kinda zoom out and in of the document structure. You could use any folding extension for your favourite text editor, like markdown folding for vim or whatever text editor you enjoy. I personally think that folding is super helpful when structuring documents of any size. The idea with Org Mode (and the like) is just to keep everything in one large text file, rather than lots of entries (like, say a Wiki) in possibly deeply nested subfolder hierarchy.

Another option for document layout with a huge amount of images is Scribus. It works well will hundreds of images without demanding much RAM, even though it is WISYWIG (unlike Org Mode). Scribus built-in text editing is very limited, but is awesome at typesetting longer texts when imported.

4