STAUPELL ANALYTICS GROUP - ANALYTICS EXPERTS FOR NONPROFITS, IMPROVING FUNDRAISING
  • Home
  • About
    • Staupell Team
    • Testimonials
    • Partnerships >
      • Prospect Research Institute
      • Lityx
      • TouchPoints
      • Gravyty
  • Services
    • Fundraising Analytics
    • Prospect Development
    • Business Intelligence
    • Database Administration
    • Fundraising Optimization Solution
  • Training
    • Analytics Machine Learning Artificial Intelligence
    • Business Intelligence Visualization Reporting
    • Prospect Research and Management
    • Webinars
    • Classes >
      • Beginner Analytics Using R
      • Analytics Classes
      • Skill Builder Series
    • Workbooks
  • Blog
  • Events
    • Water Cooler Chats
    • Video Replays
  • Contact
  • Product

Driven by Data Blog

Text Mining Is No Longer Intimidating

2/6/2023

0 Comments

 
Picture
​In the world of nonprofit data management, we work really hard to smart code all of our interactions with our audience so that we can successfully report on them. However, we work in a relationship industry and that often requires detailed explanation, which, translated to data speak, is free text. And there is our conundrum.

Processing free text is the domain of artificial intelligence, a discipline that we nonprofit data scientists are learning now. The new processing program, Python, even has a package called Beautiful Soup which parses websites, the text within them, and the HTML tags marking any variety of content. The R program also has a package called SentimentAnalysis which assigns a sentiment to different words by using the package’s dictionary, called a lexicon.
​
But we can do some of this analysis without an artificial intelligence program. Here are some steps to work your way into trying out text parsing, starting with the easy stuff and working toward the sophisticated stuff.
  1. **Bag-of-Words Model:** This theory involves splitting text into single words, assigning a predetermined value to each parsed word, and then counting them up. Your version of this could be a word cloud, which we at Staupell have done using Excel and Tableau. Assigning meaning to the words requires a separate lexicon, which you can then use to add value to your word cloud.
  2. Phrase parsing: Called NGRAMS in some programs, parsing text into 1-, then 2-, then 3-word phrases allows for finding those phrases which indicate the sentiment that you’re looking for. I use WEKA to process text this way, but IBM’s Text Analytics software also intuitively identifies phrases depending on the lexicon (dictionary) that you use. I have even used SQL to do the work. When I have worked with IBM’s product, I have set my lexicon for client satisfaction, but the product can create a custom lexicon, so that phrases like, “promoted to” can be marked with a “career” tag.
  3. Looking for specific triggers. This exercise can even be done in Excel using the “match” function. Words like, “sold”, “gave”, or your organization’s name along with a quote can be identified. If you are using Python or R, use regular expressions to find them. Then flag them.
There was a study that I heard about years ago (and I wish I could find it now) where a suicide hotline identified through data science the keywords that indicated that the caller really meant to cause self-harm. To me, that is the best use of text analytics. Your work, since you are in a nonprofit, is also for a noble cause.

​Try some of these tricks and see what you can glean from contact reports. And let us know what you find.
0 Comments

    Keep Informed
    Sign up for
    notifications when a
    new post comes out

    Sign Up Now


    Authors

    Marianne Pelletier has more than 30 years of experience in fundraising, with the majority in prospect research and prospecting.

    Greg Duke helps Raiser’s Edge clients to optimize their database by implementing data clean-up techniques and creating reporting structures, including dashboards and SQL queries.  He also facilitates data imports into Raiser’s Edge and database administration.

    Categories

    All
    Advancement Svcs
    Annual Giving
    Artificial Intelligence
    Assessment
    Big Data
    Blackbaud
    Branding
    Dashboards
    Databases
    Data Management
    Data Mining
    Data Prep
    Dependent Variables
    Donor Modeling
    Efficiency
    Engagement
    GDPR
    Giving Variables
    Linear Regression
    Machine Learning
    Major Gifts
    NFT
    Participation
    Productivity
    Project Planning
    Prospecting
    Prospect Research
    Push Technology
    Raiser's Edge
    RE NXT
    Reporting
    Research Pride
    RFM
    Statistics

    Archives

    March 2023
    February 2023
    January 2023
    December 2022
    October 2022
    September 2022
    August 2022
    July 2022
    June 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    March 2021
    September 2020
    June 2020
    May 2020
    March 2020
    February 2020
    July 2019
    May 2019
    March 2019
    December 2018
    September 2018
    May 2018
    March 2018
    September 2017
    June 2017
    March 2017
    January 2017
    December 2016
    September 2016
    June 2016
    April 2016
    March 2016
    February 2016
    January 2016
    December 2015

    View my profile on LinkedIn
Picture
© COPYRIGHT 2023 Staupell Analytics Group. ALL RIGHTS RESERVED.
  • Home
  • About
    • Staupell Team
    • Testimonials
    • Partnerships >
      • Prospect Research Institute
      • Lityx
      • TouchPoints
      • Gravyty
  • Services
    • Fundraising Analytics
    • Prospect Development
    • Business Intelligence
    • Database Administration
    • Fundraising Optimization Solution
  • Training
    • Analytics Machine Learning Artificial Intelligence
    • Business Intelligence Visualization Reporting
    • Prospect Research and Management
    • Webinars
    • Classes >
      • Beginner Analytics Using R
      • Analytics Classes
      • Skill Builder Series
    • Workbooks
  • Blog
  • Events
    • Water Cooler Chats
    • Video Replays
  • Contact
  • Product