tags : education, Computation and Computer Theory, Math, Cricket’24

How to read paper?

3 approaches

Solution Finding

Immediate solutions for problems at hand, similar to reading SO/reference books.

Discovery

This is basically going down the rabbithole idea but which a aim to improve/optimize find better alternatives to your original idea.

Curiosity

Just reading things out of curiosity! It can surprise you how useful these random ideas can be :)

Other tips

  • Avoid reading new papers at all. Focus on the classics, and let time filter out papers that are worth reading.
  • Paper writers are mostly one of these three: Academics, Engineers, Industrial Labs
  • Identify the methods used. They are the primary metric when analyzing results.
  • Long term learning is a good way to get time for reading research papers.

Papers/Editorials

Here’s the org-mode format of academic publication types with each section and its items organized in org-tables:

Primary Research Publications

TypeDescription
Original Research ArticlesReports new findings from empirical studies, experiments, or analyses
Brief Reports/Short CommunicationsShorter articles presenting preliminary or limited findings warranting rapid publication
Case Studies/Case ReportsDetailed analyses of individual cases, common in medicine, psychology, and business

Theoretical and Conceptual Works

TypeDescription
Theoretical PapersPresent new theories, frameworks, or conceptual models without necessarily including empirical testing
Methodological PapersIntroduce new research methods, statistical approaches, or analytical techniques

Scholarly Communication Formats

TypeDescription
Conference Papers/ProceedingsResearch presented at academic conferences, often published in collected volumes
PreprintsEarly versions of research papers shared before formal peer review
Book ChaptersContributions to edited volumes focusing on specialized topics
MonographsBook-length studies on a single subject by a single author or author team

Applied Research Outputs

TypeDescription
Technical ReportsDetailed reports on technical projects by government agencies, research institutions, or companies
White PapersAuthoritative reports that inform readers about complex issues and present an organization’s philosophy
Policy BriefsShort documents specifically aimed at government or organizational decision-makers

Educational and Outreach Publications

TypeDescription
TextbooksComprehensive educational resources on specific subjects
Popular Science ArticlesResearch communicated for non-specialist audiences

Meta-Research and Commentary

TypeDescription
Commentaries/Opinion PiecesScholarly perspectives on current research, often invited by journals
Letters to the EditorBrief communications responding to previously published articles
EditorialsPieces written by journal editors highlighting important research or issues

Doing Reviews

Review TypePurposeMethodologyTime Required
Systematic ReviewAnswer a specific research question with minimal biasComprehensive search with explicit protocol, inclusion/exclusion criteriaHigh
Meta-AnalysisQuantitatively combine and analyze results from multiple studiesStatistical pooling of data from similar studiesHigh
Realist ReviewUnderstand what works, for whom, in what contextsTheory-driven approach examining mechanismsHigh
Integrative ReviewSynthesize findings from diverse methodologiesIncorporates experimental and non-experimental researchMedium to High
Scoping ReviewMap key concepts and evidence in a research areaBroad search strategy without quality assessmentMedium
State-of-the-Art ReviewProvide current understanding and future directionsComprehensive search of recent advancesMedium
Umbrella ReviewSynthesize multiple systematic reviewsSystematic search for published reviews onlyMedium
Critical ReviewCritically evaluate literature with deep analysisIn-depth analysis of a manageable number of worksMedium
Narrative ReviewProvide a broad perspective on a topicSelective literature search based on author expertise(subjective)Low to Medium
Rapid ReviewProvide timely evidence for urgent decisionsStreamlined systematic review methodsLow

Doing Literature Review

  • Define your research question clearly.
    • Starting with a clear research question prevents feeling overwhelmed by the amount of available research. For example, when researching the “Bayesian brain,” a research question could be “What does the Bayesian brain mean? How does it work?“.
  • Find a good review and accompanying relevant research
    • For this we can also use https://elicit.com/
    • When new to a topic, she searches for reviews (e.g., “Bayesian brain review”) and sorts them by highest citation to find key foundational papers
    • She also identifies leading authors in the field using Scopus to understand who the major contributors are (e.g., Karl Friston in computational neuroscience).
  • Import these papers into a “dedicated” folder in Zotero or similar thing
  • Put the set of selected papers into citation mapping software
    • Eg. Litmaps, ResearchRabbit etc.
    • Get more sources
  • Read through them / analyze
    • Do classical reading/note-taking
    • Put all of those sources into NotebookLM
      • Usually you’d want to generate a TOC of each source(unchecking other sources) to understand your source
  • Organize insights
    • distilling each paper into a main question, a key statement, or a central fact
  • Synthesize the literature into your own review.
    • involves thinking critically about the acquired knowledge, interpreting it, identifying gaps, and formulating your own questions.

Using the literature review for knowledge work

  • Now that we have GOOD inputs in our notebookLM source list
    • We can now “ask the question” we want to ask via notebookLM. This is like a much better google search results.
  • After we have got a good enough response, we can put that to a more creative LLM like claude
    • notebookLM is tuned to hallucinate less. So it works good with factual data.

AI Research in India

Deploying ML applications (applied ML) @novasarc01 i’ll tell what’s really happening:

  1. there is no strong ecosystem of research here even in the so called top institutes…research is in hands of few institutions…and any local student who has ideas or wants to do the research can’t access it easily…the students in these institutions don’t have interest or motivation to pursue meaningful research projects like open source LLMs, mech interp, AI alignment, VLMs

  2. also there are no specialized research groups and labs in institutes like RL group, Interpretability Group, Parallel Programming Group, Semiconductor research group, marine robotics group where students from any college of the country can take part and do research under profs…why no specialized research group? no support from the institutions

  3. the condition of local state unis is even worse…forget about research folks are not even interested in learning specialized skills and their only goal is to get out of the uni instantly…you can’t even think to start specialized research groups here

  4. percentage of people who are serious about their research is very low…and they go outside the country to pursue research (and they should definitely go) considering the opportunities, already established strong research ecosystem and SOTA infrastructure

  5. and its not new…from past few years i too was wondering why there are no huge open source projects in india where people are contributing…even the top cream fails to build such projects

  6. there is no support for students starting from high school to develop interest in research…when i used to present ideas for doing research projects people used to laugh at me and used to say that instead of doing homework i am giving excuse to do other things…i also contacted few researchers but there was no response

  7. today we have unimaginable opportunities from other countries which include microgrants for research, research fellowships, research project groups…and i am proud to see that people who are really interested in pursuing research are already leveraging them