之前一直使用Typora+各种博客(Wordpress/Hexo/Typecho)来进行笔记和写作，后来接触并爱上了语雀，主要是贴图太方便了。（使用Typora的时候会搭配PicGo+云存储，但是有时候会粘贴了多余的图片或者想替换已有图片时，懒得打开云存储进行删除，久而久之就忘了，造成了一定的空间浪费。）
刚开始用语雀的时候还特地看了下，可以导出md格式的文章。但最近想批量导出知识库时，发现只能选择PDF或者语雀特定的格式，感觉不大放心。于是弄了个脚本通过语雀官方API导出了全部文章，并开始寻找本地存储的笔记软件。
结合个人情况进行筛选后发现Obsidian比较适合，但是由于一开始不会用，不会怎么处理图片路径的问题。语雀是没有目录这个概念的，所以导出的文章都放到了一起，然后图片等资源也统一放到了文章目录中的某一目录。而这也导致了如果我在Obsidian里通过建立多级文件夹的方式来分类文章，那么所有图片链接都要进行改动，差点弃坑了。还好在B站看了关于ob的视频，学到了通过索引的方式来进行管理

先上一张Obisidian的图：
image.png

语雀文章导出

  • 基于ExportMD进行了一些小改动，修复部分Bug以及适配Obsidian
    • 正则去除语雀导出时可能存在的标签
    • 导出的图片从./assets/修改为assets/，用于匹配obsidian
  • 使用方法：
    • NameSpace：访问语雀个人主页https://www.yuque.com/<xxx>中的xxx部分
    • Token：访问语雀Token新建，只需要给读取权限即可。 ```shell $ python3 ExportMD.py

      请输入语雀namespace: xxx 请输入语雀Token: xxx

  1. ![image.png](https://cdn.nlark.com/yuque/0/2022/png/520228/1646018580971-e3771e03-fa2c-4c73-8914-ed876edfb1c2.png#clientId=u7bf0b4eb-c38c-4&from=paste&height=410&id=uc35f1821&margin=%5Bobject%20Object%5D&name=image.png&originHeight=820&originWidth=1792&originalType=binary&ratio=1&size=153680&status=done&style=none&taskId=u5b3ba5a2-9ef3-4295-bfff-fbbe94e6819&width=896)
  3. - `ExportMD.py`完整代码，感谢 [@杜大哥](https://github.com/dzh929/ExportMD-rectify-pics) 协助修复
  4. ```python
  5. # -*- coding: UTF-8 -*-
  7. from prettytable import PrettyTable
  8. import re
  9. import os
  10. import aiohttp
  11. import asyncio
  12. from urllib import parse
  13. from PyInquirer import prompt, Separator
  14. from examples import custom_style_2
  15. from colr import color
  16. from cfonts import render, say
  19. class ExportMD:
  20.     def __init__(self):
  21.         self.repo_table = PrettyTable(["知识库ID", "名称"])
  22.         self.namespace, self.Token = self.get_UserInfo()
  23.         self.headers = {
  24.             "Content-Type": "application/json",
  25.             "User-Agent": "ExportMD",
  26.             "X-Auth-Token": self.Token
  27.         }
  28.         self.repo = {}
  29.         self.export_dir = './yuque'
  31.     def print_logo(self):
  32.         output = render('ExportMD', colors=['red', 'yellow'], align='center')
  33.         print(output)
  35.     # 语雀用户信息
  36.     def get_UserInfo(self):
  37.         f_name = ".userinfo"
  38.         if os.path.isfile(f_name):
  39.             with open(f_name, encoding="utf-8") as f:
  40.                 userinfo = f.read().split("&")
  41.         else:
  42.             namespace = input("请输入语雀namespace：")
  43.             Token = input("请输入语雀Token：")
  44.             userinfo = [namespace, Token]
  45.             with open(f_name, "w") as f:
  46.                 f.write(namespace + "&" + Token)
  47.         return userinfo
  49.     # 发送请求
  50.     async def req(self, session, api):
  51.         url = "https://www.yuque.com/api/v2" + api
  52.         # print(url)
  53.         async with session.get(url, headers=self.headers) as resp:
  54.             result = await resp.json()
  55.             return result
  57.     # 获取所有知识库
  58.     async def getRepo(self):
  59.         api = "/users/%s/repos" % self.namespace
  60.         async with aiohttp.ClientSession() as session:
  61.             result = await self.req(session, api)
  62.             for repo in result.get('data'):
  63.                 repo_id = str(repo['id'])
  64.                 repo_name = repo['name']
  65.                 self.repo[repo_name] = repo_id
  66.                 self.repo_table.add_row([repo_id, repo_name])
  68.     # 获取一个知识库的文档列表
  69.     async def get_docs(self, repo_id):
  70.         api = "/repos/%s/docs" % repo_id
  71.         async with aiohttp.ClientSession() as session:
  72.             result = await self.req(session, api)
  73.             docs = {}
  74.             for doc in result.get('data'):
  75.                 title = doc['title']
  76.                 slug = doc['slug']
  77.                 docs[slug] = title
  78.             return docs
  80.     # 获取正文 Markdown 源代码
  81.     async def get_body(self, repo_id, slug):
  82.         api = "/repos/%s/docs/%s" % (repo_id, slug)
  83.         async with aiohttp.ClientSession() as session:
  84.             result = await self.req(session, api)
  85.             body = result['data']['body']
  86.             body = re.sub("<a name=\".*\"></a>","", body)  # 正则去除语雀导出的<a>标签
  87.             body = re.sub(r'\<br \/\>!\[image.png\]',"\n![image.png]",body) # 正则去除语雀导出的图片后紧跟的<br \>标签
  88.             body = re.sub(r'\)\<br \/\>', ")\n", body)  # 正则去除语雀导出的图片后紧跟的<br \>标签
  89.             return body
  91.     # 选择知识库
  92.     def selectRepo(self):
  93.         choices = [{"name": repo_name} for repo_name, _ in self.repo.items()]
  94.         choices.insert(0, Separator('=== 知识库列表 ==='))
  95.         questions = [
  96.             {
  97.                 'type': 'checkbox',
  98.                 'qmark': '>>>',
  99.                 'message': '选择知识库',
  100.                 'name': 'repo',
  101.                 'choices': choices
  102.             }
  103.         ]
  104.         repo_name_list = prompt(questions, style=custom_style_2)
  105.         return repo_name_list["repo"]
  107.     # 创建文件夹
  108.     def mkDir(self, dir):
  109.         isExists = os.path.exists(dir)
  110.         if not isExists:
  111.             os.makedirs(dir)
  113.     # 获取文章并执行保存
  114.     async def download_md(self, repo_id, slug, repo_name, title):
  115.         """
  116.         :param repo_id: 知识库id
  117.         :param slug: 文章id
  118.         :param repo_name: 知识库名称
  119.         :param title: 文章名称
  120.         :return: none
  121.         """
  122.         body = await self.get_body(repo_id, slug)
  123.         new_body, image_list = await self.to_local_image_src(body)
  125.         if image_list:
  126.             # 图片保存位置: .yuque/<repo_name>/assets/<filename>
  127.             save_dir = os.path.join(self.export_dir, repo_name, "assets")
  128.             self.mkDir(save_dir)
  129.             async with aiohttp.ClientSession() as session:
  130.                 await asyncio.gather(
  131.                     *(self.download_image(session, image_info, save_dir) for image_info in image_list)
  132.                 )
  134.         self.save(repo_name, title, new_body)
  136.         print(" %s 导出成功！" % color(title, fore='green', style='bright'))
  138.     # 将md里的图片地址替换成本地的图片地址
  139.     async def to_local_image_src(self, body):
  140.         body = re.sub(r'\<br \/\>!\[image.png\]',"\n![image.png]",body) # 正则去除语雀导出的图片后紧跟的<br \>标签
  141.         body = re.sub(r'\)\<br \/\>', ")\n", body)  # 正则去除语雀导出的图片后紧跟的<br \>标签
  143.         pattern = r"!\[(?P<img_name>.*?)\]" \
  144.                   r"\((?P<img_src>https:\/\/cdn\.nlark\.com\/yuque.*\/(?P<slug>\d+)\/(?P<filename>.*?\.[a-zA-z]+)).*\)"
  145.         repl = r"![\g<img_name>](assets/\g<filename>)"
  146.         images = [_.groupdict() for _ in re.finditer(pattern, body)]
  147.         new_body = re.sub(pattern, repl, body)
  148.         return new_body, images
  150.     # 下载图片
  151.     async def download_image(self, session, image_info: dict, save_dir: str):
  152.         img_src = image_info['img_src']
  153.         filename = image_info["filename"]
  155.         async with session.get(img_src) as resp:
  156.             with open(os.path.join(save_dir, filename), 'wb') as f:
  157.                 f.write(await resp.read())
  159.     # 保存文章
  160.     def save(self, repo_name, title, body):
  161.         # 将不能作为文件名的字符进行编码
  162.         def check_safe_path(path: str):
  163.             for char in r'/\<>?:"|*':
  164.                 path = path.replace(char, parse.quote_plus(char))
  165.             return path
  167.         repo_name = check_safe_path(repo_name)
  168.         title = check_safe_path(title)
  169.         save_path = "./yuque/%s/%s.md" % (repo_name, title)
  170.         with open(save_path, "w", encoding="utf-8") as f:
  171.             f.write(body)
  173.     async def run(self):
  174.         self.print_logo()
  175.         await self.getRepo()
  176.         repo_name_list = self.selectRepo()
  178.         self.mkDir(self.export_dir)  # 创建用于存储知识库文章的文件夹
  180.         # 遍历所选知识库
  181.         for repo_name in repo_name_list:
  182.             dir_path = self.export_dir + "/" + repo_name.replace("/", "%2F")
  183.             dir_path.replace("//", "/")
  184.             self.mkDir(dir_path)
  186.             repo_id = self.repo[repo_name]
  187.             docs = await self.get_docs(repo_id)
  189.             await asyncio.gather(
  190.                 *(self.download_md(repo_id, slug, repo_name, title) for slug, title in docs.items())
  191.             )
  193.         print("\n" + color('导出完成！', fore='green', style='bright'))
  194.         print("已导出到：" + color(os.path.realpath(self.export_dir), fore='green', style='bright'))
  197. if __name__ == '__main__':
  198.     export = ExportMD()
  199.     loop = asyncio.get_event_loop()
  200.     loop.run_until_complete(export.run())

可能出现的报错

  • 运行脚本时出现如下错误：

image.png

  • 原因是默认的最大打开文件数不够，修复方法： ```shell $ ulimit -n # 查看当前最大打开数文件 $ ulimit -n 512 # 设置多一点
  1. ![image.png](https://cdn.nlark.com/yuque/0/2021/png/520228/1640249324034-03ae2609-033a-4f8e-adbb-1c99ec76ea66.png#clientId=ue5d80edb-7f4b-4&from=paste&height=123&id=u2a4e60ea&margin=%5Bobject%20Object%5D&name=image.png&originHeight=246&originWidth=770&originalType=binary&ratio=1&size=35763&status=done&style=none&taskId=uf119372d-6c88-463f-8fd2-48da3fe0d50&width=385)
  2. <a name="cIIQ1"></a>
  3. ## 建立索引
  4. > 这里以语雀目录为内容，批量添加`obsidian`的内链格式`[[xxx]]`，以建立索引
  6. - 先复制语雀全部文档的标题，然后利用以下脚本批量添加内链格式，最后根据情况进行手动调整。
  7. ```python
  8. # -*- coding: UTF-8 -*-
  10. file = "list.txt"
  11. new_file = "list2.txt"
  13. datas = []
  15. with open(file, "r") as f:
  16.     lines = f.readlines()
  17.     for line in lines:
  18.         data = "[[" + line.strip() + "]]"
  19.         datas.append(data)
  21. with open(new_file, "w") as f2:
  22.     for line in datas:
  23.         f2.writelines(line + "\n")
  • obsidian一些配置

image.png