Framework for Success Metrics Questions | Fb Teams Success Metrics | by Magda Ntetsika | Jul, 2024

The framework that may assist you ace the Success Metrics Questions and standout

As I equipped for my Product Information Scientist interviews, I scoured the online for ideas and frameworks on dealing with the “Success Metrics” interview query. Regardless of discovering bits and items, an entire, end-to-end information was lacking. That’s why I’m excited to share the final word framework I crafted throughout my preparation, which landed me a suggestion from Meta! Dive in, and I hope it can give you the results you want too!

Framework — Assume you’re a part of the DS workforce for Fb Teams, how would you outline success metrics?

Clarifying Questions — At all times begin by asking clarifying questions. Just remember to flesh out every phrase of the query and most significantly the product in scope. For those who don’t ask any questions, that’s undoubtedly a pink flag, so please do!

Let me ask just a few clarifying questions. Are we taking concerning the Teams within the Fb core app? Is my understanding right that Teams might be non-public or public?

As soon as the query is obvious, then take a giant breath and begin your reply by taking a giant detour. Sure, you learn that proper — don’t simply leap into answering the query. It’s paramount, and most significantly anticipated, to speak concerning the product, the mission of the corporate and the way these two tie collectively earlier than anything. So please just remember to speak concerning the factors beneath.

Begin your reply by taking a giant detour — don’t simply leap into answering the query instantly however speak concerning the product, the mission of the corporate and the way these two tie collectively earlier than anything.

Firm’s Mission

To begin with, Meta’s mission is to convey individuals nearer collectively and provides them the facility to construct communities.

Purpose of the Product + the way it ties to Firm’s Mission

FB Teams aim is to convey individuals with widespread pursuits nearer collectively and it’s a crucial product of Fb since its aim ties with the general mission of Meta to convey individuals nearer collectively.

Customers — At all times speak concerning the customers. Virtually for each product there are 2 sides of customers: the producers and the customers. It is rather essential to speak concerning the person journey of each and much more essential to provide metrics later in your reply that cowl either side.

For FB Teams we’ve got two sides of customers, the admins of the teams who’re the producers and the members of the teams which are the customers.

The admins create a bunch, determine whether or not will probably be pubic/non-public, ship invitation for customers to affix, publish hyperlinks/media/data and get the dialog began within the group.

The members both see on feed, search or get invited to a bunch (relying on if it’s public or non-public) and as soon as joined, they will have interaction with the group via posting, commenting, liking, sharing and so forth.

Advantages+Prices (each for the Customers and Firm) — earlier than leaping into the metrics is nice to briefly discuss the advantages and prices of the product each for the customers and the corporate.

One of many most important advantages of FB Teams is that customers with widespread pursuits can get collectively, which ties with Meta’s mission and contributes to FB app general engagement. FB Teams additionally permit Meta to get a greater understanding of the customers’ pursuits by trying on the teams they’re members of, which in flip can assist in making higher suggestions and extra partaking feed for the customers.

On the flip facet, FB Teams may probably make customers to interact much less with FB’s Newsfeed, which is the “coronary heart” of the FB app and the place the place income is generated via advertisements. One other potential con is when teams don’t get adequate members or engagement, which may discourage the admins and create “empty shell” teams.

Varieties of Metrics to deal with — Now it’s time to start out taking about metrics. Select 2 out of Acquisition/Activation/Retention/Engagement/Monetization to deal with.

Now going to metrics, since FB Teams is a mature product, I imagine it is smart to deal with Engagement + Retention.

Point out Firm’s NSM (North Star Metric) + reporting numbers — with a view to select the first metric, it’s essential to have the NSM and reporting numbers in the back of our thoughts.

Earlier than leaping into the success metrics of the product, let me rapidly discuss Meta’s NSM, which is the variety of classes per person per day. On high of that, Meta reviews to Wall Avenue DAUs and MAUS. Therefore once we discuss success metrics, and particularly when choosing the first metric, it’s essential to maintain the above in thoughts.

Metrics — Now it’s lastly time to provide the metrics. We’ll give metrics from the 2 areas we talked about above we’d deal with and it’s essential to not over do it — 2 or 3 to-the-point metrics per space are greater than sufficient. Please notice how we make sure that to have metrics that cowl each the producer and client sides of customers.

It’s essential to have metrics that cowl each the producer and client sides of customers.

Engagement:

# of teams created per week with a minimum of 3 members per person

# of interplay inside Teams per person per week

# of classes that concerned Teams per person per week

Retention:

# of energetic days per person inside the previous 7 days (Energetic = used FB Teams)

2nd week retention = # of customers that have been energetic a minimum of as soon as every week for two consecutive weeks / # of customers energetic solely the primary week

** I selected the week as timeframe since I imagine FB Teams will not be meant for use day by day.

Select Driver/Secondary/Guardrail metrics — Now it’s time to decide on the first, secondary and guardrail metrics from our checklist of metrics above. Don’t neglect to speak concerning the trade-offs!

Driver Metric:

# of classes that concerned group per week

[# of sessions is easy to explain, captures users behavior and ties with Meta’s NSM. If sessions involving groups are up then more interaction among users → creating communities.]

Secondary Metrics:

# of teams created per week with a minimum of 3 members per person (to seize provide)

# of interplay inside Teams per person per week (to seize demand)

# of customers energetic 2 weeks in a row (this + final week) / # of customers energetic final week (2nd week retention)

Guardrail Metrics:

# of customers faraway from teams

# of teams shut down or reported

# of offensive/inappropriate posts posted on Teams per week

time spent on Newsfeed (we don’t need customers to cease utilizing Newsfeed as a lot)

Wrapping up — At all times a good suggestion to rapidly undergo the story you simply put collectively and present how/why it solutions the query.

In order that’s it — that is the framework that labored for me and helped me land a suggestion from Meta! The identical framework can be utilized for any Product/Success Metrics questions requested for Information Science positions. Having a well-structured response that completely scopes out all of the essential elements and takes the interviewer alongside your thought course of is essential. Hope you loved it and would love to listen to your suggestions within the feedback beneath!