Breidbart Index

The Breidbart Index, developed by Seth Breidbart, is the most significant cancel index in Usenet.

"Breidbart" redirects here. For similarly named persons and entities, see Breitbart.

A cancel index measures the dissemination intensity of substantively identical articles. If the index exceeds a threshold the articles are called newsgroup spam. They can then be removed using third party cancel controls.

Cancel Index

• Crossposting is the act of posting the same message to multiple newsgroups
• Multiposting is the act of posting the same contents multiple times

The principal idea of the Breidbart-Index is to give these methods different weight.[1] With a crossposted message less data needs to be transferred and stored. And excessive crossposts (ECP) are also a likely beginner's error, while excessive multiposts (EMP) suggest deliberate usage of special software.

The crucial issue is categorizing multiple articles as substantively identical.[2] This includes

• byte-for-byte identical messages
• otherwise identical postings minimally customized for each group it appears in
• advertising the same service
• articles that consist solely of the same signature
• articles which consist of inclusions of other user's postings, but are otherwise identical

Breidbart Index (BI)

The Breidbart Index of a set of articles is defined as the sum of the square root of n, where n is the number of newsgroups to which an article is cross posted.

Formula

${\displaystyle {\mbox{BI}}=\sum _{k=1}^{m}{\sqrt {n_{k}}}}$

Example

Two copies of a posting are made, one to 9 groups, and one to 16.

${\displaystyle {\sqrt {9}}+{\sqrt {16}}=3+4=7}$

Breidbart-Index, Version 2 (BI2)

A more aggressive criterion, Breidbart Index Version 2, has been proposed. The BI2 is defined as the sum of the square root of n, plus the sum of n, divided by two.[2] A single message would only need to be crossposted to 35 newsgroups to breach the threshold of 20.

Formula

${\displaystyle {\mbox{BI2}}=\sum _{k=1}^{m}{\frac {n_{k}+{\sqrt {n_{k}}}}{2}}}$

Example

Two copies of a posting are made, one to 9 groups, and one to 16.

${\displaystyle {\frac {{\sqrt {9}}+{\sqrt {16}}+9+16}{2}}={\frac {3+4+9+16}{2}}={\frac {32}{2}}=16}$

Skirvin-Breidbart Index (SBI, BI3)

The name Skirvin-Breidbart Index and the abbreviation SBI are mentioned in the Spam Thresholds FAQ.[2] However, in hierarchy nl.* this index is called BI3.[3]

The SBI is calculated similar to the BI2 but adds up the number of groups in Followup-to: (if present) instead of the number of groups in Newsgroups:. This encourages the use of Followup-to:.

Example

Two posts contain the same text. One is crossposted to 9 groups. The other is crossposted to 16, with four groups in Followup-to:.

${\displaystyle {\frac {{\sqrt {9}}+{\sqrt {16}}+9+4}{2}}={\frac {3+4+9+4}{2}}={\frac {20}{2}}=10}$

BI7 and BI30

In hierarchy de.* the Breidbart index is used with a time range of seven days instead of 45. This is denoted by the abbreviation BI7.[4]

In hierarchy hamster.de.* the Breidbart index is used with a time range of 30 days instead of 45. This is denoted by the abbreviation BI30.[5]

Cancel Index in at.*

This is defined in the FAQ [6] of the group at.usenet.cancel-reports. The term used in the Call for Votes [7] and in the FAQ is "Cancel-Index". Unofficial abbreviations are CI und ACI.

The ACI of a single post equals 3 plus the number of groups that the post was sent to. The index of multiple posts is the sum of the indices of the individual posts.

Thresholds

• According to RFC 1036 only the author of the target message or the administrator of the site that injected the message is allowed to send a cancel.
• According to the Spam Thresholds FAQ [2] a BI of 20/45 applies to all hierarchies. Series of articles above this limit may be canceled by everyone.
• In some hierarchies alternative (stricter) limits were defined through a public vote.
• No cancel messages or any derivatives thereof are allowed within free.*.[8]

In fact a cancel message is a just a non-binding request to remove a certain article. News server operators can freely decide on how to implement the conflicting policies.[9]

Hierarchy	Cancel Index	Time Range	Limit	Reports	Definition
*	BI	45	20	news.admin.net-abuse.bulletins	[2]
at.*	ACI	45	11	at.usenet.cancel-reports	[7][10]
at.anzeigen.*	ACI	14	4	at.usenet.cancel-reports	[11][12]
bln.*	BI	45	3		[13]
de.*	BI	7	5	de.admin.net-abuse.announce	[4][14]
de.alt.dateien.*	BI	45	1	de.admin.net-abuse.announce	[4][13]
de.markt.*	BI	45	2	de.admin.net-abuse.announce	[4][13][15]
es.*	BI	45	20		[16]
fr.*	BI	30	10	fr.usenet.abus.rapports	[17]
hamster.de.*	BI	30	3	hamster.cancelreport	[5]
it.*	BI	45	20	it.news.net-abuse	[18][19]
muc.*	BI	45	2		[13]
nl.*	SBI		10	nl.internet.misbruik.rapport	[3]
nrw.*	BI	7	2		[20]
schule.*	BI	14	3	schule.cancelreport	[21]

References

1. <news:36i6hk$[e-mail]>
2. Spam Thresholds FAQ
3. "Over cancelrapporten in nl.internet.misbruik". Archived from the original on 2007-08-04. Retrieved 2009-08-14.
4. <news:[e-mail]>, http://home.snafu.de/hweede/debi.txt
5. Regelsatz für hamster.de.* Archived 2013-02-10 at Archive.today
6. Spam Cancel in at.* (FAQ)
7. <news:CfV$1$at.usenet.cancel-reports$[e-mail]>
8. free.* FAQ
9. Cancel Messages: Frequently Asked Questions
10. <news:[e-mail]>
11. <news:938889391/[e-mail]>
12. <news:[e-mail]>
13. Die Jobbörse in den Newsgroups: de.markt.arbeit.*
14. "Fremdcancel-FAQ". Archived from the original on 2007-06-25. Retrieved 2009-08-14.
15. "Archived copy". Archived from the original on 2011-01-30. Retrieved 2009-08-14.CS1 maint: archived copy as title (link), <[e-mail]>
16. FAQ: SPAM.ES Archived 2010-05-03 at the Wayback Machine
17. Les annulations d'articles (Cancel)
18. Tutto quello che occorre sapere sulla cancellazione
19. Pagina Antispam in italiano
20. Regeln der nrw.*-Hierarchie
21. http://schule.afaik.de/netiquette/netiquette.txt