https://www.youtube.com/watch?v=YVWxbHJakgg
https://www.entrypointai.com/
https://medium.com/@mehrdad-/raptor-as-information-retrieval-and-raptor-as-channel-code-092f23f6d230
Sunday, May 12, 2024
Saturday, May 11, 2024
Friday, May 10, 2024
SVG Large Model
LayoutLM: Pre-training of Text and Layout for Document Image Understanding
https://www.youtube.com/watch?v=ewyDVIdKXm0
https://arxiv.org/pdf/2306.06094
https://github.com/alexandre01/deepsvg?tab=readme-ov-file
https://www.youtube.com/watch?v=pWvqc1WRp_U
Tuesday, May 7, 2024
Vector Gen
https://app.recraft.ai/projects
OpenAI Function Calling video walkthrough. We create two functions that the AI understands how to use.
Saturday, April 20, 2024
Wednesday, April 17, 2024
Tuesday, March 26, 2024
Sunday, March 17, 2024
Saturday, March 2, 2024
Search - Part2
https://medium.com/@dtunkelang/on-search-leadership-815b36c15df1
https://queryunderstanding.com/introduction-c98740502103
https://uplimit.com/course/search-with-machine-learning
1. Query Preprocessing and Understanding:
- Query Understanding: The foundational step where the search engine attempts to understand the user's intent and the meaning of the query.
- Language Identification: Detecting the language of the query to apply appropriate linguistic processing.
- Character Filtering: Cleaning the query by removing or normalizing irrelevant or harmful characters.
- Tokenization: Breaking down the query into individual words or tokens for further analysis.
- Spelling Correction: Identifying and correcting spelling errors to ensure the query reflects the user's intended search.
- Stemming and Lemmatization: Reducing words to their base or root form to improve the matching process.
- Entity Recognition: Identifying named entities (people, places, organizations) within the query to enhance understanding and retrieval accuracy.
- Taxonomies and Ontologies: Utilizing structured knowledge frameworks to interpret the query within a broader context of related concepts and relationships.
2. Query Modification and Expansion:
- Query Rewriting: Modifying the original query to improve its effectiveness, potentially including synonym replacement or rephrasing.
- Query Expansion: Adding related terms or phrases to the query to broaden its scope and retrieve more comprehensive results.
- Query Relaxation: Simplifying or broadening the query criteria to ensure results are returned even when exact matches are not found.
- Query Segmentation: Breaking the query into meaningful segments or phrases to understand the relationship between different parts of the query.
- Query Scoping: Determining the specific subset of data or indexes that the query should target based on its content or user context.
3. Contextual and Personalized Processing:
- Contextual Query Understanding: Incorporating additional context (such as the user's previous queries or the current webpage) to better interpret the query.
- Session Context: Using data from the current search session to tailor search results and suggestions.
- Location as Context: Considering the user's geographic location to deliver more relevant local results.
- Seasonality: Adjusting search responses based on seasonal trends or events relevant to the query.
- Personalization: Tailoring search results and suggestions based on the user's historical behavior and preferences.
4. Interactive Search Features:
- Autocomplete and User Experience: Predicting and suggesting possible completions for the user's query to speed up the search process.
- Search as a Conversation: Facilitating a more interactive search experience, where the system and user engage in a dialogue to refine the search.
- Clarification Dialogues: Asking follow-up questions to clarify the user's intent when the initial query is ambiguous.
- Relevance Feedback: Allowing users to provide feedback on the relevance of results to refine future searches.
5. Result Processing and Presentation:
- Faceted Search: Enabling users to refine search results based on specific attributes or categories.
- Search Results Presentation: The overall layout and presentation of search results to the user.
- Search Result Snippets: Generating short previews or summaries of each result to help users assess relevance.
- Search Results Clustering: Grouping similar results to help users navigate large sets of results more effectively.
- Question Answering: Providing direct answers to queries phrased as questions, often extracted from documents or generated by AI.
- Query Understanding
- Language Identification
- Character Filtering
- Tokenization
- Spelling Correction
- Stemming and Lemmatization
- Query Rewriting
- Query Expansion
- Query Relaxation
- Query Segmentation
- Query Scoping
- Entity Recognition
- Taxonomies and Ontologies
- Autocomplete
- Autocomplete and User Experience
- Contextual Query Understanding
- Session Context
- Location as Context
- Seasonality
- Personalization
- Search as a Conversation
- Clarification Dialogues
- Relevance Feedback
- Faceted Search
- Search Results Presentation
- Search Result Snippets
- Search Results Clustering
- Question Answering
Query Understanding
Language Identification
Character Filtering
Tokenization
Spelling Correction
Stemming and Lemmatization
Query Rewriting: An Overview
Query Expansion
Query Relaxation
Query Segmentation
Query Scoping
Entity Recognition
Taxonomies and Ontologies
Autocomplete
Autocomplete and User Experience
Contextual Query Understanding
Session Context
Location as Context
Seasonality
Personalization
Search as a Conversation
Clarification Dialogues
Relevance Feedback
Faceted Search
Search Results Presentation
Search Result Snippets
Search Results Clustering
Question Answering
Sunday, February 25, 2024
Search
https://d3.harvard.edu/platform-digit/submission/etsy-keeping-commerce-human-with-ai/
https://opensearch.org/docs/latest/search-plugins/searching-data/autocomplete/
https://opensearch.org/docs/latest/search-plugins/neural-search-tutorial/
https://medium.com/@andre.luiz1987/using-query-rescore-elasticsearch-e438d572387c
https://eng.snap.com/embedding-based-retrieval
Writing OpenSearch Extensions in Python
https://www.youtube.com/watch?v=TZy7ViZbbHc&t=2s
Saturday, February 24, 2024
Friday, February 23, 2024
Platform Team - Functions Roles
The functions of an Android/iOS platform architect team supporting other teams generally revolve around establishing a strong foundation for app development, ensuring best practices are followed, and facilitating the creation of high-quality, performant, and secure applications. These functions can be broadly categorized into several key areas:
1. Design and Architecture:
- Defining App Architecture: They establish the overall architecture for Android/iOS applications, including the choice of patterns such as MVC, MVP, MVVM, or Clean Architecture, ensuring scalability, maintainability, and testability.
- Framework Selection: Help in choosing the right frameworks and libraries to speed up development while ensuring they are reliable and secure.
- API Design: Guide the design of APIs for optimal performance on mobile devices, taking into account factors like network conditions and battery usage.
2. Development Support:
- Coding Guidelines: Set coding standards and best practices to ensure code quality, readability, and consistency across all development teams.
- Code Review: Implement code review practices to maintain quality, share knowledge, and catch issues early.
- Performance Optimization: Provide expertise on optimizing app performance, including memory management, efficient battery usage, and smooth UI/UX.
3. Security:
- Security Practices: Ensure that the apps follow the best security practices to protect user data and comply with legal and regulatory standards.
- Encryption and Data Protection: Advise on implementing encryption and data protection measures suitable for the sensitive information handled by the apps.
4. Testing and Quality Assurance:
- Testing Frameworks: Recommend and help implement testing frameworks and practices, including unit tests, integration tests, and UI tests, to ensure the reliability of the apps.
- Continuous Integration/Continuous Deployment (CI/CD): Set up CI/CD pipelines to automate testing and deployment processes, reducing the time to market and improving product quality.
5. Cross-Team Collaboration:
- Knowledge Sharing: Facilitate knowledge sharing and training sessions for developers on the latest Android/iOS developments, best practices, and emerging technologies.
- Problem Solving: Act as consultants to other teams to help solve complex technical challenges.
- Inter-Departmental Liaison: Work with other departments, such as design, marketing, and product management, to ensure that the technical implementation aligns with business goals and user needs.
6. Innovation and Research:
- Emerging Technologies: Explore and experiment with emerging technologies and tools that can be leveraged to enhance app functionality and user experience.
- Prototyping: Develop prototypes for new features or applications based on cutting-edge technology trends.
7. Documentation:
- Technical Documentation: Create and maintain comprehensive technical documentation for internal developer guidelines, API usage, and architecture descriptions to ensure smooth onboarding and reference for developers.
By performing these functions, Android/iOS platform architect teams play a crucial role in enabling other teams to build robust, efficient, and innovative applications that meet business objectives and delight users.
Subscribe to:
Posts (Atom)